From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E8EE7429A7 for ; Fri, 21 Apr 2023 19:42:17 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 558A94113C; Fri, 21 Apr 2023 19:42:17 +0200 (CEST) Received: from mail-pl1-f178.google.com (mail-pl1-f178.google.com [209.85.214.178]) by mails.dpdk.org (Postfix) with ESMTP id 09097410FB for ; Fri, 21 Apr 2023 19:42:15 +0200 (CEST) Received: by mail-pl1-f178.google.com with SMTP id d9443c01a7336-1a526aa3dd5so27167675ad.3 for ; Fri, 21 Apr 2023 10:42:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682098934; x=1684690934; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=QY1YBUQ/48kTIMp9Ph861cYTbP3z0yr578bYt8iVCww=; b=WzoyMUeJCw+/Bl9uqxYRK/Dri0ne9qS3vRDcu4SOWYYCL/ov2F6hwzL5405EdcQdU1 NAG6zBgM6R86ZG8Nt8g+Qpd5WM0CQwBszv7hZmR/LsT4+naq+vSHthm0oSmxw4ZZZ7+R Z7EmW6iDnmh68Cgk8/GhOqOdb8obpamxFytKws44zvMJgD9oKgg3QxkmImxvEQO7Kvlq xr0TMTd+7d1zTnBqTYYM2tAR91r4A03jxmp5T5sbs8HQW7NVkExl8mvlBf4FewKgEi77 ZIXBxH6JBU/Wk0Kh4qoH+Up06GvX7xwKfhD2Vx5eDxkttS6ZWwP69t2BeIrsFtIpzr+l jmUA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682098934; x=1684690934; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=QY1YBUQ/48kTIMp9Ph861cYTbP3z0yr578bYt8iVCww=; b=iug4MescRdbOx2a+AK1iKBdffiZbRv0c+AwwCEpVL+Onx1ewHPbM47osFikwh8v+Sl uBsQ61Pa8FD03YSiH/pwIv1ew+PHAvKUzDAEMsbwluyCwHVrLyRgAnp43GQ9Vu/RVZqT ydS4ghFY+FPcrcSxtA1EecJN4TIV67cBh9mXwIg8VfuNv5aethyt7JmMxeEk4Z4ySXk5 zjUFMSyQ21BMC0eIoMur7b0Q0sFBIxm/UiFKkKpMukGJyI/RhufjtfLBa+1AFBZUZ4dz teKeuR0AkdVUHoi6rzTp1RO0gHe45ydGkQO96l5ATTgdhuRb33HZuz2Kp7Si8/Mk2Hra iUUQ== X-Gm-Message-State: AAQBX9eNU2orzIHSe+GWlmHV3RCf5GnDSDzdE8bCKqnthe5MnuPXg1cu 3Uj30UbgCqOjBmCaD3qJXs+4V0NIj3Nj+HOPuZY= X-Google-Smtp-Source: AKy350axGrb6eOtgCgaXVSRIc/HOWZvKPlNI4VysAcZ0MK532rQVcAysvu1NgfrIvCJzGeGUZ1RTafcZNoREyiROvvI= X-Received: by 2002:a17:903:2302:b0:1a0:7584:f468 with SMTP id d2-20020a170903230200b001a07584f468mr7006504plh.0.1682098933887; Fri, 21 Apr 2023 10:42:13 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Igor de Paula Date: Fri, 21 Apr 2023 18:42:02 +0100 Message-ID: Subject: Re: Issue with rte_eth_dev_start To: Verghis Koshi Cc: users@dpdk.org Content-Type: multipart/alternative; boundary="0000000000006e77c505f9dc2d04" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --0000000000006e77c505f9dc2d04 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Custom pc with of the shelf HW. Intel i350-t4 NIC for example. On Fri, Apr 21, 2023, 18:39 Verghis Koshi wrote: > Hi Igor, > Just curious, what's your setup? Server or laptop? > > Verghis > > On Fri, Apr 21, 2023 at 5:37=E2=80=AFAM Igor de Paula wrote: > >> From what I can tell, dpdk calles the function vfio_disable_msix in >> the stop and start function. The reason it does not happen in start up i= s >> that I don't call stop before. >> Calling stop and then start calls the function twice. Which maybe >> shouldn't happen... Is it a bug? >> >> On Thu, Apr 20, 2023 at 12:33=E2=80=AFPM Igor de Paula >> wrote: >> >>> Hi, >>> I am having trouble with restarting a HW port allocated to DPDK. >>> I am running the DPDK version: 21.08.0 and Ubuntu 20.04.3 LTS. >>> The driver is : net_e100igb >>> After I start the port with no issues I try to call rte_eth_dev_stop to >>> stop it. >>> When I am ready I call rte_eth_dev_start to start it again an I get the >>> following message: >>> EAL: Error disabling MSI-X interrupts for fd 46. >>> I am not sure what this error is coming from and what it causes. >>> I found little information online. If someone could explain, I would >>> really appreciate it. >>> This is a copy print on setup with no issues: >>> 2023-04-20 11:09:51.703542: Driver: net_e1000_igb >>> 2023-04-20 11:09:51.703546: Bus Id: 0000:01:00.0 >>> 2023-04-20 11:09:51.703551: rx offload cap: 280e (92e0f) >>> 2023-04-20 11:09:51.703555: tx offload cap: 8002 (803f) >>> 2023-04-20 11:09:51.703559: NUMA Socket: 0 >>> 2023-04-20 11:09:51.703563: MAC Address: b4:96:91:63:62:40 >>> 2023-04-20 11:09:51.703568: Max Rx Queue: 8 >>> 2023-04-20 11:09:51.703572: Max Tx Queue: 8 >>> 2023-04-20 11:09:51.703577: Max Rx Descriptors: 4096 >>> 2023-04-20 11:09:51.703581: Max Tx Descriptors: 4096 >>> 2023-04-20 11:09:51.703585: Max Rx Packet Length: 16383 >>> 2023-04-20 11:09:51.703589: Available Link Speeds: 10Mb/s 100Mb/s >>> 1Gb/s >>> 2023-04-20 11:09:51.703608: Fixed Link Speed: Auto >>> 2023-04-20 11:09:51.703616: Fixed Duplex: Auto >>> 2023-04-20 11:09:51.703623: MTU Set to: 16383 >>> 2023-04-20 11:09:51.703632: Actual Rx Descriptors: 4096 >>> 2023-04-20 11:09:51.703636: Actual Tx Descriptors: 4096 >>> 2023-04-20 11:09:51.703695: Set up 1 send queues >>> 2023-04-20 11:09:51.703700: Actual MTU: 16383 >>> 2023-04-20 11:09:51.703704: Actual Linkspeed: 0 >>> 2023-04-20 11:09:51.703708: Actual duplex: 0 >>> 2023-04-20 11:09:51.703713: Successfully set port interrupt event >>> 2023-04-20 11:09:51.818085: Flow control turned off for Port 0 >>> 2023-04-20 11:09:51.844179: Port 0 up and running >>> 2023-04-20 11:09:51.844303: Event type: LSC interrupt >>> 2023-04-20 11:09:51.844382: Port 0 Link Down >>> >>> And after I stop and start: >>> 2023-04-20 11:11:00.492428: Driver: net_e1000_igb >>> 2023-04-20 11:11:00.492476: Bus Id: 0000:01:00.0 >>> 2023-04-20 11:11:00.492526: rx offload cap: 280e (92e0f) >>> 2023-04-20 11:11:00.492576: tx offload cap: 8002 (803f) >>> 2023-04-20 11:11:00.492624: NUMA Socket: 0 >>> 2023-04-20 11:11:00.492672: MAC Address: b4:96:91:63:62:40 >>> 2023-04-20 11:11:00.492721: Max Rx Queue: 8 >>> 2023-04-20 11:11:00.492770: Max Tx Queue: 8 >>> 2023-04-20 11:11:00.492813: Max Rx Descriptors: 4096 >>> 2023-04-20 11:11:00.492851: Max Tx Descriptors: 4096 >>> 2023-04-20 11:11:00.492889: Max Rx Packet Length: 16383 >>> 2023-04-20 11:11:00.492958: Available Link Speeds: 10Mb/s 100Mb/s >>> 1Gb/s >>> 2023-04-20 11:11:00.493207: Fixed Link Speed: Auto >>> 2023-04-20 11:11:00.493301: Fixed Duplex: Full >>> 2023-04-20 11:11:00.493822: MTU Set to: 16383 >>> 2023-04-20 11:11:00.493889: Actual Rx Descriptors: 4096 >>> 2023-04-20 11:11:00.493936: Actual Tx Descriptors: 4096 >>> 2023-04-20 11:11:00.494190: Actual MTU: 16383 >>> 2023-04-20 11:11:00.494229: Actual Linkspeed: 0 >>> 2023-04-20 11:11:00.494266: Actual duplex: 1 >>> 2023-04-20 11:11:00.494305: Successfully set port interrupt event >>> *EAL: Error disabling MSI-X interrupts for fd 46* >>> 2023-04-20 11:11:00.603181: Flow control turned off for Port 0 >>> 2023-04-20 11:11:00.629151: Port 0 up and running >>> 2023-04-20 11:11:00.629222: Event type: LSC interrupt >>> 2023-04-20 11:11:00.629273: Port 0 Link Down >>> >>> >>> Thanks, >>> Igor >>> >>> >>> --0000000000006e77c505f9dc2d04 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Custom pc with of the shelf HW.
Intel i3= 50-t4 NIC for example.

On Fri, Apr 21, 2023, 18:39 Verghis Koshi <= ;vkoshi@gmail.com> wrote:
Hi Igor,
= =C2=A0=C2=A0=C2=A0 Just curious, what's your setup?=C2=A0 Server or lap= top?

Verghis

On Fri, Apr 21, 2023 at 5:37= =E2=80=AFAM Igor de Paula <igordptx@gmail.com> wrote:
<= blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-l= eft:1px solid rgb(204,204,204);padding-left:1ex">
From what= I can tell, dpdk calles the function=C2=A0 vfio_disable_msix =C2=A0in the = stop and start function. The reason it does not happen in start up is that = I don't call stop before.
Calling stop and then start calls the func= tion=C2=A0twice. Which maybe shouldn't happen... Is it a bug?=C2=A0

On Thu, Apr 20, 2023 at 12:33=E2=80=AFPM Igor de Paula <igord= ptx@gmail.com> wrote:
Hi,
I am having trouble with restarting a = HW port allocated to DPDK.
I am running the DPDK version: 21.08.0 and Ub= untu 20.04.3 LTS.
The driver is : net_e100igb
After I start the port = with no issues=C2=A0I try to call rte_eth_dev_stop to stop it.
When I am= ready I call rte_eth_dev_start to start it again an I get the following me= ssage:
EAL: Error disabling MSI-X interrupts=C2=A0for fd 46.
I am not= sure what this error is coming from and what it causes.
I found little = information online. If someone could explain,=C2=A0I would really appreciat= e it.
This is a copy print on setup with no issues:
2023-04-20 11:09:= 51.703542: =C2=A0 =C2=A0 Driver: net_e1000_igb
2023-04-20 11:09:51.70354= 6: =C2=A0 =C2=A0 Bus Id: 0000:01:00.0
2023-04-20 11:09:51.703551: =C2=A0= =C2=A0 rx offload cap: 280e (92e0f)
2023-04-20 11:09:51.703555: =C2=A0 = =C2=A0 tx offload cap: 8002 (803f)
2023-04-20 11:09:51.703559: =C2=A0 = =C2=A0 NUMA Socket: 0
2023-04-20 11:09:51.703563: =C2=A0 =C2=A0 MAC Addr= ess: b4:96:91:63:62:40
2023-04-20 11:09:51.703568: =C2=A0 =C2=A0 Max Rx = Queue: 8
2023-04-20 11:09:51.703572: =C2=A0 =C2=A0 Max Tx Queue: 8
20= 23-04-20 11:09:51.703577: =C2=A0 =C2=A0 Max Rx Descriptors: 4096
2023-04= -20 11:09:51.703581: =C2=A0 =C2=A0 Max Tx Descriptors: 4096
2023-04-20 1= 1:09:51.703585: =C2=A0 =C2=A0 Max Rx Packet Length: 16383
2023-04-20 11:= 09:51.703589: =C2=A0 =C2=A0 Available Link Speeds: 10Mb/s 100Mb/s 1Gb/s
= 2023-04-20 11:09:51.703608: =C2=A0 =C2=A0 Fixed Link Speed: Auto
2023-04= -20 11:09:51.703616: =C2=A0 =C2=A0 Fixed Duplex: Auto
2023-04-20 11:09:5= 1.703623: =C2=A0 =C2=A0 MTU Set to: 16383
2023-04-20 11:09:51.703632: = =C2=A0 =C2=A0 Actual Rx Descriptors: 4096
2023-04-20 11:09:51.703636: = =C2=A0 =C2=A0 Actual Tx Descriptors: 4096
2023-04-20 11:09:51.703695: = =C2=A0 =C2=A0 Set up 1 send queues
2023-04-20 11:09:51.703700: =C2=A0 = =C2=A0 Actual MTU: 16383
2023-04-20 11:09:51.703704: =C2=A0 =C2=A0 Actua= l Linkspeed: 0
2023-04-20 11:09:51.703708: =C2=A0 =C2=A0 Actual duplex: = 0
2023-04-20 11:09:51.703713: =C2=A0 =C2=A0 Successfully set port interr= upt event
2023-04-20 11:09:51.818085: =C2=A0 =C2=A0 Flow control turned = off for Port 0
2023-04-20 11:09:51.844179: =C2=A0 =C2=A0 Port 0 up and r= unning
2023-04-20 11:09:51.844303: Event type: LSC interrupt
2023-04-= 20 11:09:51.844382: =C2=A0 =C2=A0 Port 0 Link Down

And after I stop = and start:
2023-04-20 11:11:00.492428: =C2=A0 =C2=A0 Driver: net_e1000_i= gb
2023-04-20 11:11:00.492476: =C2=A0 =C2=A0 Bus Id: 0000:01:00.0
202= 3-04-20 11:11:00.492526: =C2=A0 =C2=A0 rx offload cap: 280e (92e0f)
2023= -04-20 11:11:00.492576: =C2=A0 =C2=A0 tx offload cap: 8002 (803f)
2023-0= 4-20 11:11:00.492624: =C2=A0 =C2=A0 NUMA Socket: 0
2023-04-20 11:11:00.4= 92672: =C2=A0 =C2=A0 MAC Address: b4:96:91:63:62:40
2023-04-20 11:11:00.= 492721: =C2=A0 =C2=A0 Max Rx Queue: 8
2023-04-20 11:11:00.492770: =C2=A0= =C2=A0 Max Tx Queue: 8
2023-04-20 11:11:00.492813: =C2=A0 =C2=A0 Max Rx= Descriptors: 4096
2023-04-20 11:11:00.492851: =C2=A0 =C2=A0 Max Tx Desc= riptors: 4096
2023-04-20 11:11:00.492889: =C2=A0 =C2=A0 Max Rx Packet Le= ngth: 16383
2023-04-20 11:11:00.492958: =C2=A0 =C2=A0 Available Link Spe= eds: 10Mb/s 100Mb/s 1Gb/s
2023-04-20 11:11:00.493207: =C2=A0 =C2=A0 Fixe= d Link Speed: Auto
2023-04-20 11:11:00.493301: =C2=A0 =C2=A0 Fixed Duple= x: Full
2023-04-20 11:11:00.493822: =C2=A0 =C2=A0 MTU Set to: 16383
2= 023-04-20 11:11:00.493889: =C2=A0 =C2=A0 Actual Rx Descriptors: 4096
202= 3-04-20 11:11:00.493936: =C2=A0 =C2=A0 Actual Tx Descriptors: 4096
2023-= 04-20 11:11:00.494190: =C2=A0 =C2=A0 Actual MTU: 16383
2023-04-20 11:11:= 00.494229: =C2=A0 =C2=A0 Actual Linkspeed: 0
2023-04-20 11:11:00.494266:= =C2=A0 =C2=A0 Actual duplex: 1
2023-04-20 11:11:00.494305: =C2=A0 =C2= =A0 Successfully set port interrupt event
EAL: Error disabling MSI-X = interrupts for fd 46
2023-04-20 11:11:00.603181: =C2=A0 =C2=A0 Flow = control turned off for Port 0
2023-04-20 11:11:00.629151: =C2=A0 =C2=A0 = Port 0 up and running
2023-04-20 11:11:00.629222: Event type: LSC interr= upt
2023-04-20 11:11:00.629273: =C2=A0 =C2=A0 Port 0 Link Down

Thanks,
Igor


--0000000000006e77c505f9dc2d04--