From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM03-DM3-obe.outbound.protection.outlook.com (mail-dm3nam03on0057.outbound.protection.outlook.com [104.47.41.57]) by dpdk.org (Postfix) with ESMTP id 42CB92B92 for ; Fri, 31 Mar 2017 19:08:01 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=lo4T1jxBcKMtqeOVKKaOIxl8dDbIeU3NA9D+4Vxgr2A=; b=FWJJqNqzD0lLIob42+y/pTNQEeaeNPhhb00GFKmLafMci8pA6o7kzxrnFXszBgwoLs/Qt4QJemx5SXQJtrILrip9JjiFG2HxHpRO9fiNKtov0/r/22yNfcONz99vfrRcfo/eQ5hvpq8sOKB2ThPQ0jKX9iez2w/bb7pfFa8z0RU= Authentication-Results: dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=none action=none header.from=caviumnetworks.com; Received: from [10.0.0.11] (31.172.191.173) by DM2PR0701MB810.namprd07.prod.outlook.com (10.242.127.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.991.14; Fri, 31 Mar 2017 17:07:59 +0000 To: dts@dpdk.org From: Angela Czubak Message-ID: <497f3137-740d-72fc-c038-984b21d8b961@caviumnetworks.com> Date: Fri, 31 Mar 2017 19:07:49 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [31.172.191.173] X-ClientProxiedBy: VI1PR0501CA0029.eurprd05.prod.outlook.com (10.168.132.15) To DM2PR0701MB810.namprd07.prod.outlook.com (10.242.127.24) X-MS-Office365-Filtering-Correlation-Id: 73af9db6-7911-4f1b-0d9c-08d478587bfc X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(201703131423075)(201703031133081); SRVR:DM2PR0701MB810; X-Microsoft-Exchange-Diagnostics: 1; DM2PR0701MB810; 3:IV1VYrVD5/eyIHnCDUzrADJ5Zq7OMe6mHiTtIdZ/gaIVqhtIe+E50dIn4zzcx2Kk9xachr/Dak4PF3VBKXXczx3jXu0J9TnMi/5CH46L7JV6fsfIRG/sPrLZafuqvpk7xP6bdmE5844uU1S8HAh1KF3KZxgCTjjUHky7xYL/3hyieDBOulfSv2Lys9SH0VTkhTmW9RtIf23Zzy4p8RvymKfh+YQr5dfNHQ9gycRwV0YVBQ1brbfr5MDjhYB7/Nruz993aYj6k+tNeAyl3jlahQPBaYCJ13jZxXwFe3jG/XNrfWMvlmsMFBDu3JC1WmuEd2NPBU0o6yQWyfxRMOcWgQ==; 25:8lGBZhUYu7DXWWdxcPI5cy5x6Q6ZYOFzxSnY5F+R4e+qzQvYl/LKnCSd5UTbwWiPwIyCRYhJJkqptnONBag4mGhribeyIBIMjtCqVvtKJopxNg4M2FY2J6XpwkSPi3YgxVmWS5lRHA/ygmr/Y4SNQquOgZr7RfdSB4OcBX3+JXBy1tma6so+q4GFpi1QQG+8JZoS5IGCh0gLx21waaJqKUk5OPNLEb8OYVJku11Gf0Fyb92xXhN5MkPcXkEwalXCvj42RFtO44tWIbY+k53sKdu4BNROCSQ300BppodOl+5RsS5n/VEOSRnSeGOqQoJCV4704Ao9WW5HGyvfVrNEmbTQiIi7gJBxtwDsFFONg+WlCBoQk7MWEdQfXExGSgiuzHnEWFr/LJ+lzJxp0ekzsljzlO/ISJir0p1WgmcK0gzc3OWhmzrjlgFGBh+u5QvHcYz/uCKUd/O81HBR0BqTfQ== X-Microsoft-Exchange-Diagnostics: 1; DM2PR0701MB810; 31:YsRtevrctZZJzWB0TO1sikJjg2chIWER2Dfg3g3GfEy00OjfIXsmbhBKNdJ64E43RomuBhlZ3B3GxNsFLet+ne6jG3PRtVK+w/1ZustjGI5Xq3Jid1v5JmfX9oITekVWt8hysdtCS01hLKA7kX4T8RycFQUiqQv/aJu0d1SlSqKMQUS8rKyOIEjF59e0I2ahrD4GrH/qgZpfGbg7cADgLVWGnGzJv+FuuN3i1ZF4qJXxflBHJRRplgOxBLrayjTuwGv1LNGwM4+yALlNuDbT9lSj16TDvcfYQe3oXCjjoNU=; 20:fSpzARw3n8VlRzUFp6vM3r4WD3wDgme/rTEaoeNnQGAhkaBBw9IRzGf6KRT5ypLU7NwoEtrKpQV3brrXaoeOfBsMMbskfiBmw5OdM4pntciR1HbY9prL3yWnHSWS56k2eH7vIw8sGsI++rAdRHJXETt7oZIPuFI7S0umjaDFvF8BWLYvnt1XEoz2J69vH0bfmCA6fY3uRfjBPtC259YpOG8B0pmNdnAyh0EMQpIfodGCA4A0Bb8EZU/IrgaOrJjcN9va639feECgO5norWNOqo3ATRRnJ2ukJICCc6D+DShQIBCG5WEgNqPmU7FQFhVgEsR9QKfk7+6gTjR/8oL7RWjGaLT5dZrwMsA+xlBb4HS+ZShLGWVFdZ12sr/m4b2AspusTc3eENPc2geZtjqaHQEcptQsznYE2zbULKTKVoo6aIKAUciflU1K2MKlm3ap+Qw7uXY+7zqMZ62eBGUf0NltF9NXGvnH9bwN2GnUq88zOeAczk+m+HlnszMuZawCLXrCFqWcRjfLcj+jh2jqTakh0bgFqj/hcmt/olQtJB49+y0KhrchnR7bZRNeyhESjh2JpcQPc+vhRbtPk2nPi6lJRDMimURg7ySoQM/YGsE= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040450)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(93006095)(6041248)(201703131423075)(201702281528075)(201703061421075)(20161123555025)(20161123562025)(20161123564025)(20161123560025)(6072148); SRVR:DM2PR0701MB810; BCL:0; PCL:0; RULEID:; SRVR:DM2PR0701MB810; X-Microsoft-Exchange-Diagnostics: 1; DM2PR0701MB810; 4:X15GPlhAM84y74MQ1Nli32YLQNQTv05nmnS3UkvKyGWwRsP3JDJi/liPNamHwEP5w4TZ+sYL+6gNJdKF2EL/xUI/ln5PoDugGZu+7nE7yvbDOpGa159SYZw/knxz/M7A4R7QOUiQKW5iPOmi7TRsKyGdKTdCDyOfSd7qb26TxYDUQWdIF3R2EEjzQ1wU1fqaFSMg3uSkT/byHKDab0uNCpEJ0yHOBJVOFkXt0JQ8BWwl5Z3627lC87nNyh6gfK5Rvi/HRcOItmveqXf59HwHqfJzQFjOnp4HSGN54ZnFI09asfi2TDDwl/2+bnSpnlI2mUVjSU7OE7tX/HhfGdmZk3H6mZKtcxNfhpBpLJxerjHX9Diy9MBEHYbUmhWhcngAoVx3PkrWBoQxRS7eSAlqmhOak/8hZXuaeo5uEOiBfL6eqAjMmSzJRmsrXgXDJoO7YNTZPAh9r54QsJVf3Qn5jMdAaJoFxQqBgFQ3Ho/P3xbmUrP/5ZrAXAvKL6DgblJ8wpokKmKHCGh+a3q/0CrlSjd91ApIWELU3rD5yPT2ZL7UDJslwJkLxIKkqiwClpd/iZZaXaOpXLeP47kj6PDWq/Ont1oTAC9mvwwXoXjONjlN2TMSEmfbbZkeGFq++A58mfab4AWmbQvNnO53UxZekLgRIZet8H7zYAdKM10Waf0hbfN27lFDovbXH6R7X7Jz X-Forefront-PRVS: 02638D901B X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6049001)(6009001)(39450400003)(39840400002)(39410400002)(39400400002)(39850400002)(66066001)(2351001)(4001350100001)(50986999)(65956001)(8676002)(65806001)(54356999)(2361001)(81166006)(42882006)(6486002)(77096006)(47776003)(64126003)(31696002)(6666003)(2906002)(36756003)(6916009)(33646002)(110136004)(42186005)(31686004)(5660300001)(3846002)(6116002)(23676002)(305945005)(38730400002)(230700001)(53936002)(83506001)(50466002)(25786009)(65826007)(189998001); DIR:OUT; SFP:1101; SCL:1; SRVR:DM2PR0701MB810; H:[10.0.0.11]; FPR:; SPF:None; MLV:sfv; LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtETTJQUjA3MDFNQjgxMDsyMzpLMGs3eG56VVRONk95bXB6ZkROWE1NTyt4?= =?utf-8?B?MkF0akJzL3hOYjBKUlhzMEh1dC81ditXa3l6YVZQMzhxQUtZS0lYUUtDR2U5?= =?utf-8?B?anlQc0hTb2QwZDdpT1RZRTc2Tlp5eUVMeU5kMWJoM0RicVRWU0pmbnZNRnRG?= =?utf-8?B?dTdTZGhvK0ZxUmN3U0ZLN2d6WEZ6MTBMOUViOFYrM1RPK1p0SlZhWFB6c1E5?= =?utf-8?B?K0w5WFBhM3hyNTBnbzZNYUZUL1ZGejVVVnRIUUNsbERQMDltdGxSVURSMXlz?= =?utf-8?B?T2FUc3N2ZFhCYTdiV2FhdmV4REE4aUNwK0l2ZzdMZzVIdVBLR2EzeCtXVWlO?= =?utf-8?B?eTg3cnA1aXovSFRuVFcrc2JjaG9qSGZ2UzFDc29BV2NUWXQzYkp4Rm5FR0hs?= =?utf-8?B?bHpUWE54aEdiSFZwMDFkakx0NldzREdjTTIycmlNL0RHL1liTHJlcjBUZU1S?= =?utf-8?B?YXgxNHF2SWthSjhybTZjVGtlblJhc3N3RW1WemoyUzUwb044NExjcm4zYkVw?= =?utf-8?B?VVl1MEY1ZDZjWXFsVFNDRHFrR29WUkhPdWVqMFlFaU81YTBsRE9EK0d4Skp0?= =?utf-8?B?VmJBRkpaR2YwY3BnRmlTQzlaNTYzNmdpdUtNWW5pL3VQdEkrWUFpWElTWDhs?= =?utf-8?B?c0cxSGtYcjRDQklSS29HNUl1Mjk2bXZ5eWlrV0dITWRycnZhMERRTDV1NlFT?= =?utf-8?B?dUdMVXN3aEt1TFlTaXJUTlB6RVB4N2sySXdQSE9wbmU2RmVsSUhoTmNCZ3hh?= =?utf-8?B?am1YbWNWaXlqbkdqNWNLSW9xcXRMWnZSWXlMTXhzZGd6RjZpa2hZNVExY2pz?= =?utf-8?B?cDJxbndEMGR6Tzg5dGorUGUzcUJVdTJqbWYxNFdGc0I0N2J3K0JSY2JjWDkx?= =?utf-8?B?QmpsWWtSeEFqaEYxdnViQlJ3bU5UNUZuc2ZBMWwrWEhtRTBWN2xVSzN4SU9Q?= =?utf-8?B?MVAyd3NUV2s3MjFiY0NEZWgzUnhFdHN1ZmMyaTBTWHVvRzFaa3V0QlRxUkdY?= =?utf-8?B?dTgyZVVuZU93V0ZPOUFEMXlkcWdtdzFtZlpUNmJKRkN0azlDVkIyeHVmMUxB?= =?utf-8?B?VXNNWHNJYURzelhFTUZVdXdBNmp6M3NhTG4rNmhJaE04c05xWklDZ1Ntazln?= =?utf-8?B?YkQ3dC90dS83SlRQWm8rQ0FMU2VBdzlzNkp5Wm5RS3lZUWkrREVJeVpTM08v?= =?utf-8?B?SGdPcXd5dE1WRHlYYUhqNUloNGJUVDNqRWFMTkx1MytIMlNyc2RrQUZxVjE5?= =?utf-8?B?dFdmelYwQTl0RjZmaEhrTVk3ZFFMSTRyRC9Sc3JScnNPUUlOSXBLT2JJSmQy?= =?utf-8?B?V1lXYnJxdHN4RUtWRG43aGp4K1VFQVFENm9DNmNldmY2RlZ6VEc2bU1iMURJ?= =?utf-8?B?TXJKNVVSM0QzTnVVb0NXdE9MVUVxbm9rdzNONWpsUVZvemxiQklmTFFienJv?= =?utf-8?B?S05NT0JQMzRmM01PcTFWM2cxWGZRT3JsZkl4K3IyOUNNSktaanhTMU8ra294?= =?utf-8?Q?iwfnUX9H4PevEKS6rGqy32lpqMyuw/Tm5DruAI0h0ilu/UV?= X-Microsoft-Exchange-Diagnostics: 1; DM2PR0701MB810; 6:9//IsTn0y5GecX4bO5yvmTeKM9JfLoU0Bn8bpGZ4kR5uuEIVab82Q5mpe0eAUEr4Zzsz2w/5vQKkKagjOCEeX4XbT4a9Z0x2pZbY9PyrFXChaw3xDWAmQ3Z3Hp6X1yi3qCAwB5ekiNcTbj67vQhuqym7Kgt/6WNtU28o1olwaqORyuA7PbK3G7a3fU/vh/zVvBK8jepydRLXtHloUrRBWgvK01O7wI6M6k6s9cBTvScBg5SX+JOMruSo/x09cQ2gUaq41co/sHIj5iSn2C+sANPXUnCa2DGPSyULCEDzG2q6HL+7QxNh+UzPhF1T1NEiMMFyM1bvq0cihd4eOS24zJuOC5IIk5Pt5uioIJb1IAhOrywf0o1AZLrpYzMOzNcWsZtx8JcdEyz25bJJXSfXUw==; 5:pdpbrd1k5Yz38ZmZxfNJNBfOF6W4DEh4W45D5vgquqSy4yFtuVQ+LhfSHrsYwS2k4UziYeZ6Cc8kmFRM6xEnHuqYu217xm2MoHabwhWjdszqE3dCjpIMcM31LIPj82memV75Z0GTNe6EXxnTy5fPgQ==; 24:ZQqKLvBrf9L6GVDyPeT7FRhjeAgGJaUJFuLBfXJR6mMrnmjzHBvNYED7ANCKHVEMY+lp0qJizW0N/aQh5WUOiLtfdc/YJ6NDXoTpA/+qt7k= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; DM2PR0701MB810; 7:RcrMBnOj/xSDMzhaXNQMyTAOZAkMdPCRhQuRneIC0sd18p/V0BbeFkKA/91hV8Y5CU75DRdymhkMHjzyKayLb1jc1OecGVnR08jRbLMpnpW33inu1Dt1gJ578xB8TFKix2lcethJ2VPJ9LpUXhGrp8WsYRhEuA42JcdO2oKtedXjfLUawmPM7psZiv4E+ULiDdeJuDW/I0ZVbaPbihVvwqpTgNLFIB50Ib3QNNNU8/vBk6OrzCXVHXvBvCwJgARJqWIh+F9WvLDCbWMpbdmAPfwx3N5Q2S29dQqT5NBsICheGDGhi2p1mBwbxzXJ8CLsamfeTRfvwaO7dz2YehZcXQ== X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 Mar 2017 17:07:59.3990 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM2PR0701MB810 Subject: [dts] Correct way of skipping tests X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Mar 2017 17:08:01 -0000 Hi, I am working on adding support for Cavium NICs in DTS and I have stumbled upon several issues. I can see there are two *xls file in conf directory. What is the difference between dpdk_support_test_case.xls and dpdk_test_case_checklist.xls? I understand that adding a NIC and a test case to either make this test case be skipped for the NIC but I do not really know which one should be used and when. Are these spreadsheets meant to be modified manually? I just want to know if a binary patch on either of these files is OK or maybe there is a better way to add information about which tests should be skipped for a particular NIC. What is more, is there a generic way of skipping some parts of test cases? For instance I can see in TestSuite_checksum_offload.py that sending out IP/SCTP packets is skipped if the driver is fm10k. It seems very specific and adding more checks in that manner to every test case seems not to be very flexible. Is there already a structure somewhere holding similar type of information, for example that SCTP tx offload is not supported for a list of drivers (including fm10k and possibly others)? I have not managed to detect this kind of variable and I am wondering if there is a reason this kind of setting lacking capabilities is missing (and just hardcoded comparisons seem to be used). Regards, Angela Czubak