From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from ustc.edu.cn (smtp2.ustc.edu.cn [202.38.64.46]) by dpdk.org (Postfix) with ESMTP id 50F43F94 for ; Wed, 31 Oct 2018 18:18:57 +0100 (CET) Received: by ajax-webmail-newmailweb.ustc.edu.cn (Coremail) ; Thu, 1 Nov 2018 01:18:50 +0800 (GMT+08:00) X-Originating-IP: [114.214.177.51] Date: Thu, 1 Nov 2018 01:18:50 +0800 (GMT+08:00) X-CM-HeaderCharset: UTF-8 From: zzqq2199@mail.ustc.edu.cn To: users@dpdk.org X-Priority: 3 X-Mailer: Coremail Webmail Server Version XT3.0.8 dev build 20160401(82936.8581) Copyright (c) 2002-2018 www.mailtech.cn ustc-xl X-SendMailWithSms: false MIME-Version: 1.0 Message-ID: <510fd5fa.49f36.166cb2289f3.Coremail.zzqq2199@mail.ustc.edu.cn> X-Coremail-Locale: zh_CN X-CM-TRANSID: LkAmygDX3Tn649lboefLAA--.1W X-CM-SenderInfo: p22t1jqrzzqzxdloh3xvwfhvlgxou0/1tbiAQgPAFQhmkk8YwAAs- X-Coremail-Antispam: 1Ur529EdanIXcx71UUUUU7IcSsGvfJ3iIAIbVAYjsxI4VWxJw CS07vEb4IE77IF4wCS07vE1I0E4x80FVAKz4kxMIAIbVAFxVCaYxvI4VCIwcAKzIAtYxBI daVFxhVjvjDU= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Bring DPDK on ConnectX-3 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 17:18:59 -0000 SGnvvIwKClJlY2VudGx5IEkgaGF2ZSB3b3JrZWQgb24gcnVubmluZyBkcGRrIG9uIG91ciBpbmZp bmliYW5kIGNhcmQgYnV0IGZhaWxlZC4gT3VyIGFkYXB0ZXJzIGNhcmQgaXMgQ29ubmVjdFgtMywg d2hpY2ggaXMgaW4gdGhlIGRwZGvigJlzIHN1cHBvcnQgaGFyZHdhcmVzIGxpc3QsIGJ1dCBzcGVj aWZpYyB0eXBlLCBNU1g2NzEwLUZTMkYyIGlzIG5vdCBmb3VuZCBpbiBkZXRhaWxlZCBzdXBwb3J0 IG5pY3MgbGlzdCBvZiBtbHg0LiAKCkVudmlyb25tZW50CgpBZGFwdGVyIGNhcmQ6IE1lbGxhbm94 IE1TWDY3MTAtRlMyRjIgQ29ubmVjdFgtMwoKQ2VudE9TIHZlcnNpb246IENlbnRPUyBMaW51eCBy ZWxlYXNlIDcuNS4xODA0IChDb3JlKQoKTGludXggdmVyc2lvbjogTGludXggdmVyc2lvbiAzLjEw LjAtODYyLjExLjYuZWw3Lng4Nl82NCAoYnVpbGRlckBrYnVpbGRlci5kZXYuY2VudG9zLm9yZykg KGdjYyB2ZXJzaW9uIDQuOC41IDIwMTUwNjIzIChSZWQgSGF0IDQuOC41LTI4KSAoR0NDKSApCgpJ YnN0YXQ6CgogICAgICAgICBDQSAnbWx4NF8wJwoKICAgICAgICBDQSB0eXBlOiBNVDQwOTkKCiAg ICAgICAgTnVtYmVyIG9mIHBvcnRzOiAxCgogICAgICAgIEZpcm13YXJlIHZlcnNpb246IDIuNDIu NTAwMAoKICAgICAgICBIYXJkd2FyZSB2ZXJzaW9uOiAxCgogICAgICAgIE5vZGUgR1VJRDogMHhl YzBkOWEwMzAwYjM1ZmQwCgogICAgICAgIFN5c3RlbSBpbWFnZSBHVUlEOiAweGVjMGQ5YTAzMDBi MzVmZDMKCiAgICAgICAgUG9ydCAxOgoKICAgICAgICAgICAgICAgIFN0YXRlOiBBY3RpdmUKCiAg ICAgICAgICAgICAgICBQaHlzaWNhbCBzdGF0ZTogTGlua1VwCgogICAgICAgICAgICAgICAgUmF0 ZTogNTYKCiAgICAgICAgICAgICAgICBCYXNlIGxpZDogMTcKCiAgICAgICAgICAgICAgICBMTUM6 IDAKCiAgICAgICAgICAgICAgICBTTSBsaWQ6IDE5CgogICAgICAgICAgICAgICAgQ2FwYWJpbGl0 eSBtYXNrOiAweDAyNTE0ODZhCgogICAgICAgICAgICAgICAgUG9ydCBHVUlEOiAweGVjMGQ5YTAz MDBiMzVmZDEKCiAgICAgICAgICAgICAgICBMaW5rIGxheWVyOiBJbmZpbmlCYW5kCgogCgpRdWVz aW9uIERlc2NyaXB0aW9uCgogCgpJIHRyaWVkIHNldmVyYWwgdmVyc2lvbnMgb2YgZHBkayBvbiBv dXIgaW5maW5pYmFuZCwgYW5kIGdvdCBkaWZmZXJlbnQgZXJyb3JzLgoKRHBkay0yLjAuMDoKCjEu IFJ1biB0b29scy9kcGRrX25pY19iYW5kLnB5LCB0aGVyZSBpcyBubyBDb25uZWN0WC0zIGluIG91 dHB1dC4KCjIuIFJ1bm5pbmcgaGVsbG93b2xyZCBpcyBvay4KCjMuIFJ1bm5pbmcgbDJmd2QgaXMg ZmFpbGVkLgoKLi9idWlsZC9sMmZ3ZCAtbCAwLTMgLW4gNCAtLSAtcSA4IC1wIGZmZmYKCkluaXRp YWxpemluZyBwb3J0IDAuLi4gUE1EOmxpYnJ0ZV9wbWRfbWx4NDogMHg5NTE5NjA6IFRYIHF1ZXVl cyBudW1iZXIgdXBkYXRlOiAwIC0+IDEKClBNRDogbGlicnRlX3BtZF9tbHg0OiAweDk1MTk2MDog UlggcXVldWVzIG51bWJlciB1cGRhdGU6IDAgLT4gMQoKUE1EOiBsaWJydGVfcG1kX21seDQ6IDB4 OTUxOTYwOiBRUCBzdGF0ZSB0byBJQlZfUVBTX0lOSVQgZmFpbGVkOiBJbnZhbGlkIGFyZ3VtZW50 cwoKRUFMOiBFcnJvciAtIGV4aXRpbmcgd2l0aCBjb2RlOiAxCgpDYXVzZTogcnRlX2V0aF9yeF9x dWV1ZV9zZXR1cDplcnI9LTIyLCBwb3J0PTAKCkRwZGstMTYuMDcuMihuZXh0IHZlcnNpb24gb2Yg ZHBkay0yLjAuMCkKCjEuIFJ1biB0b29scy9kcGRrX25pY19iYW5kLnB5LCBhbmQgaXQgcHJpbnRz IENvbm5lY3RYLTMKCjIuIFJ1bm5pbmcgaGVsbG93b3JsZCBpcyBmYWlsZWQKCi4vYnVpbGQvaGVs bG93b3JsZCAtYyBmIC1uIDQKCkVBTDogRXJyb3IgLSBleGl0aW5nIHdpdGggY29kZTogMQoKQ2F1 c2U6IFJlcXVlc3RlZCBkZXZpY2UgMDAwMDo4MjowMC4wIGNhbm5vdCBiZSB1c2VkCgogCgpOb3cg SSB3b25kZXIgOgoKMS4gSWYgb2ZmaWNpYWwgZHBka3Mgb25seSBzdXBwb3J0IHRoZSBvbmUgbmlj IG9mIG1seDQgbGlzdGVkIGluIG9mZmljaWFsIGd1aWRlKGh0dHA6Ly9kb2MuZHBkay5vcmcvZ3Vp ZGVzL25pY3MvbWx4NC5odG1sI3N1cHBvcnRlZC1uaWNzKQoKMi4gRm9yIENvbm5lY3RYLTMqLCBD b25uZWN0WC00KiwgaWYgb2ZmaWNpYWwgZHBka3Mgb25seSBzdXBwb3J0IGV0aGVybmV0IGFkYXB0 ZXIgYnV0IG5vdCBpbmZpbmliYW5kIGFkYXB0ZXIgdmVyc2lvbj8KCgoKCgoKClRoYW5rcywKClF1 YW4= >From roszenrami@gmail.com Wed Oct 31 19:06:07 2018 Return-Path: Received: from mail-ot1-f42.google.com (mail-ot1-f42.google.com [209.85.210.42]) by dpdk.org (Postfix) with ESMTP id A82FF91 for ; Wed, 31 Oct 2018 19:06:07 +0100 (CET) Received: by mail-ot1-f42.google.com with SMTP id f24so9668227otl.5 for ; Wed, 31 Oct 2018 11:06:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=vv/Sjtad2YwwNVh/MRZKbjiEsZql2OGc7n1mUwsO1rw=; b=K+DnHy6fqzJyVLQ4zVh6x7wzttpjp5TH8vmGuNenvdCdHpl/4yqtTCpqc7ciHsUNgx JnjtYGBx8T2/qBoE9nED7p25FgdSQLYCLQ9OOTXilPEEWKWWK+2Kd0vjgsksdjEAk/z4 H5Xrr8krBmbBRUbybXzkzb/yquvOL0VscMXHqqnt3ISCocl23xJSBhyNibLQ1sIlgN0/ rFTkO6hzkLKjSdZD8HJcIRIGciCvj1IozTWpQQEqqegUUbsC7EA5ermuzintL9nwUYGN 9mp3n2iQF4AJY3X4OXtXX9vOLm+0cR70P3lzSVsx40meSC61u3s+aA8QSX868IjZU5Mq cYYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=vv/Sjtad2YwwNVh/MRZKbjiEsZql2OGc7n1mUwsO1rw=; b=dq8g2XRnTJk+ekrLosqOpXGRVqQQ8yL7yBXn6RGrtzTzPteZR+SRw04T3NJ2IzQujZ viXF4kLjK227UQWU0BC3M80aezz5bDiH68RRXo+mUIxC/a4YpvoPN6hWpnTBqMLSLxwR TFnXs6U9t0p4b/qs5cE3E5IhboxlHQVbXbbls8z2+cwTd7pyYdLJOsSK0+LLvrLQmSn4 MM1pWv7ga9uRvuqPSczRfU/MPAssxMxkmkKrDO+cl+QVuoiFJODmxxdpU/mVzM8187Bv 5KbVr9ykxlwUN/MRSM5yTFR54DRs5oDy091GjnIYA3fWkrsDG/8QCuOU+LTXkrvrOhAm CIBA== X-Gm-Message-State: AGRZ1gLRHIDR2/6JP2Xr3Z/t0tO2P8cYsOIV3A0DTjX6mI4VrZoMV4FV Y9dDViN3U9sA+8cbvr2ZYBZ0F5kPnZsK3yMbRkE= X-Google-Smtp-Source: AJdET5dc9EMtWCSR9dLUoju7KEeLyEc1ogIuyD3ujgDCJwPgBRWQ4phzRw9V4hLccoH6HZ+aM3UDVTCWUE5fTCRxb84= X-Received: by 2002:a9d:7285:: with SMTP id t5mr2485097otj.345.1541009166785; Wed, 31 Oct 2018 11:06:06 -0700 (PDT) MIME-Version: 1.0 References: <510fd5fa.49f36.166cb2289f3.Coremail.zzqq2199@mail.ustc.edu.cn> In-Reply-To: <510fd5fa.49f36.166cb2289f3.Coremail.zzqq2199@mail.ustc.edu.cn> From: Rami Rosen Date: Wed, 31 Oct 2018 20:05:57 +0200 Message-ID: To: zzqq2199@mail.ustc.edu.cn Cc: users@dpdk.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Bring DPDK on ConnectX-3 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 18:06:08 -0000 Hi Quan Not all mlx4 devices are supported by DPDK. What does "lspc -n" how on your host ? This can help in order to see if your device is supported by DPDK . Regards, Rami Rosen =D7=91=D7=AA=D7=90=D7=A8=D7=99=D7=9A =D7=99=D7=95=D7=9D =D7=93=D7=B3, 31 = =D7=91=D7=90=D7=95=D7=A7=D7=B3 2018, 19:19, =D7=9E=D7=90=D7=AA : > Hi=EF=BC=8C > > Recently I have worked on running dpdk on our infiniband card but failed. > Our adapters card is ConnectX-3, which is in the dpdk=E2=80=99s support h= ardwares > list, but specific type, MSX6710-FS2F2 is not found in detailed support > nics list of mlx4. > > Environment > > Adapter card: Mellanox MSX6710-FS2F2 ConnectX-3 > > CentOS version: CentOS Linux release 7.5.1804 (Core) > > Linux version: Linux version 3.10.0-862.11.6.el7.x86_64 ( > builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat > 4.8.5-28) (GCC) ) > > Ibstat: > > CA 'mlx4_0' > > CA type: MT4099 > > Number of ports: 1 > > Firmware version: 2.42.5000 > > Hardware version: 1 > > Node GUID: 0xec0d9a0300b35fd0 > > System image GUID: 0xec0d9a0300b35fd3 > > Port 1: > > State: Active > > Physical state: LinkUp > > Rate: 56 > > Base lid: 17 > > LMC: 0 > > SM lid: 19 > > Capability mask: 0x0251486a > > Port GUID: 0xec0d9a0300b35fd1 > > Link layer: InfiniBand > > > > Quesion Description > > > > I tried several versions of dpdk on our infiniband, and got different > errors. > > Dpdk-2.0.0: > > 1. Run tools/dpdk_nic_band.py, there is no ConnectX-3 in output. > > 2. Running hellowolrd is ok. > > 3. Running l2fwd is failed. > > ./build/l2fwd -l 0-3 -n 4 -- -q 8 -p ffff > > Initializing port 0... PMD:librte_pmd_mlx4: 0x951960: TX queues number > update: 0 -> 1 > > PMD: librte_pmd_mlx4: 0x951960: RX queues number update: 0 -> 1 > > PMD: librte_pmd_mlx4: 0x951960: QP state to IBV_QPS_INIT failed: Invalid > arguments > > EAL: Error - exiting with code: 1 > > Cause: rte_eth_rx_queue_setup:err=3D-22, port=3D0 > > Dpdk-16.07.2(next version of dpdk-2.0.0) > > 1. Run tools/dpdk_nic_band.py, and it prints ConnectX-3 > > 2. Running helloworld is failed > > ./build/helloworld -c f -n 4 > > EAL: Error - exiting with code: 1 > > Cause: Requested device 0000:82:00.0 cannot be used > > > > Now I wonder : > > 1. If official dpdks only support the one nic of mlx4 listed in official > guide(http://doc.dpdk.org/guides/nics/mlx4.html#supported-nics) > > 2. For ConnectX-3*, ConnectX-4*, if official dpdks only support ethernet > adapter but not infiniband adapter version? > > > > > > > > Thanks, > > Quan