From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 23FD6A0559 for ; Mon, 16 Mar 2020 13:17:39 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 0E4BD25D9; Mon, 16 Mar 2020 13:17:39 +0100 (CET) Received: from mga04.intel.com (mga04.intel.com [192.55.52.120]) by dpdk.org (Postfix) with ESMTP id F05CECF3; Mon, 16 Mar 2020 13:17:36 +0100 (CET) IronPort-SDR: jYu9V8V0MYZnj01MUTflgYRlAU4IvG0vWoumzPQFBNTI2Uk//iSwBTqnjXzUaEWFJDogDKkzVE sN78YCvXM+KA== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga006.jf.intel.com ([10.7.209.51]) by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 16 Mar 2020 05:17:34 -0700 IronPort-SDR: nr0BvaZCvMkz4YEdtDRgQZ3glecxWlhrUKIyICFJsdEt3C6Jzx68DeHRnqEaKvwngOYgZRanqd Fx/VLWFFPKrA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.70,560,1574150400"; d="scan'208";a="247437965" Received: from irsmsx101.ger.corp.intel.com ([163.33.3.153]) by orsmga006.jf.intel.com with ESMTP; 16 Mar 2020 05:17:34 -0700 Received: from irsmsx112.ger.corp.intel.com (10.108.20.5) by IRSMSX101.ger.corp.intel.com (163.33.3.153) with Microsoft SMTP Server (TLS) id 14.3.439.0; Mon, 16 Mar 2020 12:17:33 +0000 Received: from irsmsx103.ger.corp.intel.com ([169.254.3.138]) by irsmsx112.ger.corp.intel.com ([169.254.1.23]) with mapi id 14.03.0439.000; Mon, 16 Mar 2020 12:17:33 +0000 From: "Richardson, Bruce" To: Thomas Monjalon CC: "web@dpdk.org" , "ci@dpdk.org" Thread-Topic: [dpdk-web] [PATCH] add general testing guidelines Thread-Index: AQHV9yjzkY7mbILj/0efL6L58oQFFqhK/YzQgAAl9YCAAAOqsA== Date: Mon, 16 Mar 2020 12:17:32 +0000 Message-ID: <59AF69C657FD0841A61C55336867B5B0975C978B@IRSMSX103.ger.corp.intel.com> References: <20200310221130.46599-1-thomas@monjalon.net> <59AF69C657FD0841A61C55336867B5B0975C93E4@IRSMSX103.ger.corp.intel.com> <11237691.zAa99ISigo@xps> In-Reply-To: <11237691.zAa99ISigo@xps> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.2.0.6 dlp-reaction: no-action x-originating-ip: [163.33.239.180] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 Subject: Re: [dpdk-ci] [dpdk-web] [PATCH] add general testing guidelines X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org Sender: "ci" DQoNCj4gLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCj4gRnJvbTogVGhvbWFzIE1vbmphbG9u IDx0aG9tYXNAbW9uamFsb24ubmV0Pg0KPiBTZW50OiBNb25kYXksIE1hcmNoIDE2LCAyMDIwIDEx OjQ5IEFNDQo+IFRvOiBSaWNoYXJkc29uLCBCcnVjZSA8YnJ1Y2UucmljaGFyZHNvbkBpbnRlbC5j b20+DQo+IENjOiB3ZWJAZHBkay5vcmc7IGNpQGRwZGsub3JnDQo+IFN1YmplY3Q6IFJlOiBbZHBk ay13ZWJdIFtQQVRDSF0gYWRkIGdlbmVyYWwgdGVzdGluZyBndWlkZWxpbmVzDQo+IA0KPiAxNi8w My8yMDIwIDEwOjQzLCBSaWNoYXJkc29uLCBCcnVjZToNCj4gPiBGcm9tOiB3ZWIgPHdlYi1ib3Vu Y2VzQGRwZGsub3JnPiBPbiBCZWhhbGYgT2YgVGhvbWFzIE1vbmphbG9uDQo+ID4gPg0KPiA+ID4g VGhlIGNvbW11bml0eSBsYWIgcGFnZSBpcyByZXBsYWNlZCB3aXRoIGEgbW9yZSBnZW5lcmFsIHBh Z2UgYWJvdXQNCj4gPiA+IHRlc3RpbmcsIHdoZXJlIHRoZSBjb21tdW5pdHkgbGFiIGlzIHBhcnQg b2YgdGhlIGJpZyBwaWN0dXJlLiBJdA0KPiBpbmNsdWRlczoNCj4gPiA+IAktIHRlc3RpbmcgZ29h bHMNCj4gPiA+IAktIENJIHdvcmtmbG93DQo+ID4gPiAJLSB0b29scw0KPiA+DQo+ID4gR2VuZXJh bCBxdWVzdGlvbiAtIGlzIHRoaXMgbWVhbnQgdG8gZGVzY3JpYmUgdGhlIGlkZWFsIHN0YXRlIG9y IHRoZQ0KPiBjdXJyZW50IHN0YXRlIG9mIHRlc3Rpbmc/DQo+IA0KPiBZZXMgaXQgaXMgYWJvdXQg Z29hbHMgYW5kIHdvcmtmbG93IGRldGFpbHMsIHBsdXMgcmVmZXJlbmNlIHRoZSB0b29scyB3aGlj aA0KPiBhcmUgdXNlZC4NCj4gSSB0aGluayB0aGVzZSB0aHJlZSBpdGVtcyBnaXZlIGEgYmlnIHBp Y3R1cmUuDQo+IA0KPiA+IEl0IHN0YXJ0cyBvZmYgbGFyZ2VseSBpbnNwaXJhdGlvbmFsLCBidXQg dGhlbiBlbmRzIHdpdGggbG90cyBvZg0KPiA+IGRldGFpbHMgb24gdGhlIGN1cnJlbnQgc2V0dXAu IERvIHdlIHdhbnQgdG8gaGF2ZSB0aGF0IG1peCBpbiB0aGUgb25lDQo+IHBhZ2U/DQo+IA0KPiBJ IHBsYW4gdG8gYWRkIG9uZSBtb3JlIHBhZ2UgdG8gbGlzdCB3aGF0IGlzIGN1cnJlbnRseSBkb25l IGluIHdoaWNoIGxhYi4NCj4gU28gdGhlIHNwbGl0IGlzOg0KPiAJLSBvbmUgZ3VpZGVsaW5lIHBh Z2UgdG8gc2V0dXAgYSBsYWINCj4gCS0gb25lIHN0YXR1cyBwYWdlDQo+IA0KRG8gd2UgYW50aWNp cGF0ZSBvdGhlcnMgc2V0dGluZyB1cCBwdWJsaWMgbGFicz8gSSBzdXBwb3NlIGl0IGRvZXNuJ3Qg aHVydCB0bw0KZG9jdW1lbnQgdGhpcyBldmVuIGlmIG5vIG90aGVyIGxhYnMgYXJlIHNldCB1cC4N Cg0KPiBJIHVuZGVyc3RhbmQgeW91ciBxdWVzdGlvbiBhYm91dCBzcGxpdHRpbmcgdGhlIGd1aWRl bGluZXMgaW4gc2V2ZXJhbCBwYWdlcw0KPiBidXQgSSBkb24ndCB3aGV0aGVyIGl0IHdvdWxkIGhl bHAgcmVhZGluZywgb3IgdGhlIG9wcG9zaXRlLCBtYWtlcyBoYXJkZXINCj4gdG8gZ2V0IGFsbCBp bmZvcm1hdGlvbnMgYWJvdXQgd2hhdCBpcyBhIGxhYj8NCj4gDQpPaywgaGFwcHkgdG8ga2VlcCBp dCBhbGwgaW4gb25lIHBsYWNlLg0KDQo+ID4gSSd2ZSBhbHNvIHB1dCBzb21lIHN0eWxpc3RpYyBj b21tZW50cyBpbmxpbmUgYmVsb3cgdG9vLg0KPiBbLi4uXQ0KPiA+ID4gK1RoZXJlIGFyZSB2YXJp b3VzIHdheXMgb2YgY29udHJpYnV0aW5nIHRvIHRoZSBDSSBlZmZvcnQ6DQo+ID4gPiArDQo+ID4g PiArLSBzdWdnZXN0IGltcHJvdmVtZW50DQo+ID4gPiArLSB3cml0ZSBhIG5ldyB0ZXN0DQo+ID4g PiArLSBpbXByb3ZlIGluZnJhc3R1Y3R1cmUgc2NyaXB0cw0KPiA+DQo+ID4gVHlwbzogaW5mcmFz dFJ1Y3R1cmUNCj4gDQo+IE9LIHRoYW5rcw0KPiANCj4gPiA+ICstIHJ1biBhIGxhYg0KPiA+ID4g Kw0KPiA+ID4gK0Egc3BlY2lmaWMgZWZmb3J0IGlzIGRvbmUNCj4gPiA+ICtmb3IgdGhlIFtjb21t dW5pdHkgbGFiXSgvL2xhYi5kcGRrLm9yZy9yZXN1bHRzL2Rhc2hib2FyZC9hYm91dCkNCj4gPiA+ ICtob3N0ZWQgYXQgW1VOSC1JT0xdKC8vd3d3LmlvbC51bmguZWR1KS4NCj4gPiA+ICsNCj4gPg0K PiA+IE5vdCBzdXJlIGFib3V0IHRoZSBwaHJhc2UgInNwZWNpZmljIGVmZm9ydCIuIEhvdyBhYm91 dCAiT25lIHNwZWNpZmljIGxhYg0KPiBpbnN0YW5jZSBoYXMgYmVlbiBzZXQgdXAgZm9yIHRoZSBj b21tdW5pdHkgbGFiLi4uIg0KPiANCj4gV2hhdCBhYm91dCB0aGlzPw0KPiBPbmUgc3BlY2lmaWMg bGFiIGluc3RhbmNlLCBuYW1lZCBjb21tdW5pdHkgbGFiLCBpcyBob3N0ZWQgYXQgVU5ILUlPTC4N Cj4gDQo+IFsuLi5dDQo+ID4gPiArSWRlYWxseSwgdGhlIENJIGluZnJhc3RydWN0dXJlIHNob3Vs ZCBoYXZlIHRoZXNlIHByb3BlcnRpZXM6DQo+ID4gPiArDQo+ID4gPiArLSByZWxpYWJsZQ0KPiA+ ID4gKy0gbmV1dHJhbA0KPiA+DQo+ID4gTmV1dHJhbCBpbiB3aGF0IHdheT8gUHJlc3VtYWJseSB2 ZW5kb3Igb3IgSFcgbmV1dHJhbD8NCj4gDQo+IE5ldXRyYWwgaXMgYSBwcm9wZXJ0eSB3aGljaCBj YW4gYXBwbHkgdG8gdmVuZG9ycywgSFcgb3IgU1cgKE9TKS4NCj4gRG8geW91IHRoaW5rICJ2ZW5k b3IgbmV1dHJhbCIgaXMgYmV0dGVyPw0KPiANCldlIGp1c3QgbmVlZCB0byBjbGFyaWZ5IHdoYXQg dHlwZShzKSBvZiBuZXV0cmFsaXR5IGlzIGluIG1pbmQuIFZlbmRvciBuZXV0cmFsIGlzIHByb2Jh Ymx5IHdoYXQgcGVvcGxlIG1vc3QgbG9vayBmb3IsIHNvIEkgc3VnZ2VzdCBjaGFuZ2luZyBpdCB0 byB0aGF0IC0gaXQgaW1wbGllcyBIVyBuZXV0cmFsIEkgdGhpbmsuDQoNCj4gPiA+ICstIHRyYW5z cGFyZW50IHZpc2liaWxpdHkNCj4gPg0KPiA+IFdoYXQgaXMgaW1wbGllZCBieSB0aGlzPyBJdCBp cyAiY2xlYXIgbWV0aG9kb2xvZ3kiIG9yICJ0cmFuc3BhcmVudA0KPiB0ZXN0aW5nIG1ldGhvZHMi Pw0KPiANCj4gSSBtZWFuIHdlIHNob3VsZCBiZSBhYmxlIHRvIHNlZSB3aGljaCB0ZXN0cyBhcmUg cnVuLCB3aGF0IGlzIHRoZQ0KPiBlbnZpcm9ubWVudCwgaG93IHRlc3RzIGFyZSBjb25maWd1cmVk IGFuZCB3aGF0IGlzIHRoZSByZXN1bHQuDQo+IFRoZSBwcm9wZXJ0eSB0byBtZWFzdXJlIGlzIHJl YWxseSB0aGUgdmlzaWJpbGl0eS4NCj4gDQpJIHRoaW5rIGp1c3QgInRyYW5zcGFyZW5jeSIgaXMg cHJvYmFibHkgdGhlIGJlc3QgdGl0bGUgdGhlbi4gSG93ZXZlciwgdG8gY2xhcmlmeSB0aGluZ3Ms IEkgdGhpbmsgaXQgbWlnaHQgYmUgZ29vZCB0byBoYXZlIGEgb25lLWxpbmUgZXhwbGFuYXRpb24g b2YgZWFjaCBidWxsZXQgcG9pbnQgdG8gYWxsb3cgYWRkaXRpb25hbCBjbGFyaXR5LiBGb3IgZXhh bXBsZToNCg0KLSByZWxpYWJsZTogdXNlcnMgbmVlZCB0byBrbm93IHRoYXQgYW55IGZhaWx1cmVz IGFyZSBnZW51aW5lLCBhbmQgbm90IHRoZSByZXN1bHQgb2YgaW50ZXJtaXR0ZW50IGlzc3VlcyBp biB0aGUgdGVzdCBpbmZyYXN0cnVjdHVyZQ0KLSBuZXV0cmFsOiB0aGUgbGFiIHNob3VsZCBub3Qg Zm9jdXMgb24gb25lIEhXIG9yIFNXIHBsYXRmb3JtIHRvIHRoZSBleGNsdXNpb24gb3IgZGV0cmlt ZW50IG9mIG90aGVycw0KLSB0cmFuc3BhcmVudDogdGhlIGRldGFpbHMgb2Ygd2hhdCB0ZXN0cyBo YXZlIGJlZW4gcnVuIGFuZCB0aGUgcmVzdWx0IG9mIHRob3NlIHRlc3RzIHNob3VsZCBiZSB2aXNp YmxlIHRvIGFsbCB1c2Vycy4NCg0KPiA+ID4gKy0gY292ZXJhZ2Ugc3VtbWFyeQ0KPiA+ID4gKy0g dHJlbmRpbmcgZ3JhcGhzDQo+ID4gPiArLSByZXBvcnRzIHRvIGF1dGhvciBhbmQNCj4gPiA+ICtb dGVzdC1yZXBvcnRAZHBkay5vcmddKC8vaW5ib3guZHBkay5vcmcvdGVzdC1yZXBvcnQvKQ0KPiA+ ID4gKy0gZWFzeSB0byBhZGQgYSB0ZXN0DQo+ID4gPiArLSBlYXN5IHRvIHJlcHJvZHVjZSBhIHRl c3QgbG9jYWxseQ0KPiA+ID4gKw0KPiA+DQo+ID4gVGhlIGZpcnN0IHRocmVlIGFyZSB3aGF0IEkn ZCBjb25zaWRlciBwcm9wZXJ0aWVzLCBidXQgdGhlIHJlc3QgYXJlDQo+ID4gbW9yZSBmdW5jdGlv bnMgdGhhdCBzaG91bGQgYmUgaW5jbHVkZWQgaW4gdGhlIENJLCByYXRoZXIgdGhhbiBwcm9wZXJ0 aWVzDQo+IG9mIGl0Lg0KPiANCj4gSSBkb24ndCBhZ3JlZToNCj4gCS0gY292ZXJhZ2UgYXBwbHkg dG8gYWxsIHRlc3RzOiB3aGF0IGlzIHRoZSBjb3ZlcmFnZSBvZiBlYWNoIHRlc3Q/DQo+IAktIHRy ZW5kaW5nIGdyYXBocyBjYW4gYmUgZG9uZSBmb3IgYW55IHRlc3Qgb3IgbWVhc3VyZQ0KPiAJLSBy ZXBvcnRpbmcgbXVzdCBiZSBkb25lIGZvciBhbGwgdGVzdHMNCj4gCS0gYWJpbGl0eSB0byBhZGQg dGVzdCBpcyBhbiBpbmZyYXN0cnVjdHVyZSBwcm9wZXJ0eQ0KPiAJLSBhYmlsaXR5IHRvIHJlcHJv ZHVjZSBpcyBhIHRlc3QgcHJvcGVydHkNCj4gDQpZZXMsIEkgYWdyZWUgdGhleSBhcmUgbmVlZGVk LCB0aGV5IGp1c3QgZG9uJ3QgZml0IGluIHRoZSBzYW1lIGxpc3QgYXMgcmVsaWFiaWxpdHksIHRy YW5zcGFyZW5jeSBhbmQgbmV1dHJhbGl0eSwgd2hpY2ggYXJlIGFic3RyYWN0IGNvbmNlcHRzIHZz IGNvdmVyYWdlIHJlcG9ydHMsIHRyZW5kIGdyYXBocyBldGMuIHdoaWNoIGFyZSBjb25jcmV0ZSBv dXRwdXRzLiBUaGVyZWZvcmUgSSBzdWdnZXN0IHRoZXkgYmUgcHV0IGluIGEgc2VwYXJhdGUgbGlz dCBvbiB0aGUgcGFnZSwgbm90IGRyb3BwZWQgYWx0b2dldGhlci4NCg0KPiBbLi4uXQ0KPiA+ID4g K1RoZSB0ZXN0cyBzaG91bGQgY292ZXIgdGhlc2UgY2F0ZWdvcmllczoNCj4gPiA+ICsNCj4gPiA+ ICstIGNvbXBpbGF0aW9uDQo+ID4gPiArLSBzdGF0aWMgYW5hbHlzaXMNCj4gPiA+ICstIGZ1bmN0 aW9uYWwNCj4gPiA+ICstIHBlcmZvcm1hbmNlDQo+ID4gPiArLSBpbnRlcm9wZXJhYmlsaXR5DQo+ ID4gPiArLSBwb3J0YWJpbGl0eQ0KPiA+ID4gKy0gY29tcGF0aWJpbGl0eQ0KPiA+ID4gKw0KPiA+ DQo+ID4gV2hpbGUgY29tcGlsYXRpb24gYW5kIHN0YXRpYyBhbmFseXNpcyBhcmUgb2ssIHRoZSBy ZXN0IG5lZWQgInRlc3RpbmciDQo+IGFmdGVyIHRoZW0gc2luY2UgdGhleSBhcmUgbm90IG5vdW5z LiBBbHRlcm5hdGl2ZWx5IGRyb3AgInN0YXRpYyBhbmFseXNpcyINCj4gZnJvbSB0aGUgbGlzdCBh bmQgdGhlbiBjaGFuZ2UgY29tcGlsYXRpb24gdG8gImNvbXBpbGUiIHRvIHVzZSBvbmx5DQo+IGFk amVjdGl2ZXMuDQo+IA0KPiBJIGRvbid0IHdhbnQgdG8gZHJvcCBzdGF0aWMgYW5hbHlzaXMsIEkg dGhpbmsgaXQgaXMgYSB0ZXN0IGNhdGVnb3J5Lg0KPiBXZSBjb3VsZCBhZGQgInRlc3RpbmciIGFm dGVyIGVhY2ggaXRlbSwgYnV0IEkgZmVlbCBpdCBpcyBqdXN0IGFuIG92ZXJoZWFkLg0KPiBJIGRv bid0IGtub3cgd2hhdCB0byBkbyBoZXJlLg0KDQpNYXliZSBzcGxpdCBpdCBpbnRvIHR3byBsZXZl bHMgb2YgYnVsbGV0czoNCg0KLSBjb21waWxhdGlvbg0KLSBzdGF0aWMgYW5hbHlzaXMNCi0gdGVz dCBjYXNlIHJ1bnMsIGluY2x1ZGluZw0KICAtIGZ1bmN0aW9uYWwgdGVzdHMNCiAgLSBwZXJmb3Jt YW5jZSB0ZXN0cw0KICAtIGludGVyb3BlcmFiaWxpdHkgdGVzdHMNCiAgLSAuLi4uDQoNCklmIHRo YXQgZG9lc24ndCB3b3JrIGZvciB5b3UsIGl0J3Mgb2sgdG8gbGVhdmUgYXMtaXMuIEV2ZXJ5b25l IHdpbGwgdW5kZXJzdGFuZCBpdCwgaXQganVzdCByZWFkcyBhIGxpdHRsZSB3ZWlyZCB0byBtZS4g 8J+Yig0KDQo+IA0KPiBbLi4uXQ0KPiA+ID4gKyMjIyBQYXRjaCBUZXN0aW5nDQo+ID4gPiArDQo+ ID4gPiArV2hlbiBhIHBhdGNoIGlzIHN1Ym1pdHRlZCwgaXQgaXMgcmVjZWl2ZWQgdmlhIHRoZSBt YWlsaW5nIGxpc3QNCj4gPiA+ICtbZHBkay1kZXZdKC8vaW5ib3guZHBkay5vcmcvZGV2LykuDQo+ ID4gPiArRm9yIHNpbXBsZSB0ZXN0cywNCj4gPiA+ICtsaWtlDQo+ID4gPiArW2NoZWNrcGF0Y2hd KC8vZ2l0LmRwZGsub3JnL3Rvb2xzL2RwZGstY2kvdHJlZS90ZXN0cy9jaGVja3BhdGNoLnNoKQ0K PiA+ID4gKywgaXQgY2FuIGJlIHJ1biBkaXJlY3RseSBvbiBlbWFpbCByZWNlaXZpbmcuDQo+ID4N Cj4gPiBzL2VtYWlsIHJlY2VpdmluZy90aGUgcmVjZWl2ZWQgZW1haWwvDQo+IA0KPiBJIHdhbnRl ZCB0byBlbXBoYXNpemUgb24gdGhlIHRyaWdnZXIgd2hpY2ggInJlY2VpdmluZyIgaW5zdGVhZCBv Zg0KPiAicG9sbGluZyIuDQo+IEJ1dCAib24gdGhlIHJlY2VpdmVkIGVtYWlsIiBpcyBhbHNvIE9L LiBJcyBpdCBhIGJldHRlciBFbmdsaXNoPw0KPiANCkFoLCBvaywgSSB1bmRlcnN0YW5kIGEgbGl0 dGxlIGJldHRlci4gVG8gZW1waGFzaXNlIHRoZSB0cmlnZ2VyaW5nIHJhdGhlciB0aGFuIHdoYXQg dGhlIHNjYW4gcnVucyBvbiwgSSBzdWdnZXN0ICJvbiBlbWFpbCByZWNlcHRpb24iLCBvciBjaGFu Z2UgInJ1biIgdG8gInRyaWdnZXJlZCIgYXMgaW4gLSAidHJpZ2dlcmVkIG9uIHJlY2VpcHQgb2Yg dGhlIHBhdGNoIGVtYWlsLCBhbmQgcnVuIG9uIHRoZSBlbWFpbCBpdHNlbGYuIg0KDQovQnJ1Y2UN Cg==