[dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

[dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

[Rapelly, Varun]

Hi All,

I'm not able to send packets through OVS bridge [with dpdk] when iommu is enabled on HP DL380 G8 [RHEL 7.1]. Getting following errors in dmesg.

[    0.657681] IOMMU: Setting identity map for device 0000:01:00.2 [0xbdff6000 - 0xbdffcfff]
[    0.657686] IOMMU: Prepare 0-16MiB unity mapping for LPC
[ 4458.091522] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 1a633d000
DMAR:[fault reason 06] PTE Read access is not set
[ 4458.164541] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 1a633d000
DMAR:[fault reason 06] PTE Read access is not set
[ 4458.337565] dmar: DMAR:[DMA Read] Request device [0a:00.1] fault addr 1a63cd000
DMAR:[fault reason 06] PTE Read access is not set
[ 4458.637356] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 1a637d000
DMAR:[fault reason 06] PTE Read access is not set

Where as in another machine ProLiant DL380 G7 [RHEL 7.1] everything works fine. Is it something do with the hardware on Gen8 machine?

The following link shows the similar problem.

http://comments.gmane.org/gmane.comp.networking.dpdk.devel/2281

In the below HP link, they quoted the same problem. I upgraded ROM to the latest version, but no luck. :(

http://h20564.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c03323800



We need this flag to be enabled [SR-IOV] on that machine.



Please let me know, is there any way to resolve this issue?

Regards,
Varun

Re: [dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

[Gonzalez Monroy, Sergio]

On 24/07/2015 09:54, Rapelly, Varun wrote:
> Hi All,
>
> I'm not able to send packets through OVS bridge [with dpdk] when iommu is enabled on HP DL380 G8 [RHEL 7.1]. Getting following errors in dmesg.
>
> [    0.657681] IOMMU: Setting identity map for device 0000:01:00.2 [0xbdff6000 - 0xbdffcfff]
> [    0.657686] IOMMU: Prepare 0-16MiB unity mapping for LPC
> [ 4458.091522] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 1a633d000
> DMAR:[fault reason 06] PTE Read access is not set
> [ 4458.164541] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 1a633d000
> DMAR:[fault reason 06] PTE Read access is not set
> [ 4458.337565] dmar: DMAR:[DMA Read] Request device [0a:00.1] fault addr 1a63cd000
> DMAR:[fault reason 06] PTE Read access is not set
> [ 4458.637356] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 1a637d000
> DMAR:[fault reason 06] PTE Read access is not set
>
> Where as in another machine ProLiant DL380 G7 [RHEL 7.1] everything works fine. Is it something do with the hardware on Gen8 machine?
>
> The following link shows the similar problem.
>
> http://comments.gmane.org/gmane.comp.networking.dpdk.devel/2281
>
> In the below HP link, they quoted the same problem. I upgraded ROM to the latest version, but no luck. :(
>
> http://h20564.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c03323800
>
>
>
> We need this flag to be enabled [SR-IOV] on that machine.
>
>
>
> Please let me know, is there any way to resolve this issue?
>
> Regards,
> Varun
>
Hi Varun,

As I replied in you previous post, the issue is most likely related to HP.
You need to contact HP for a solution to your issues as suggested in the 
following thread by Lee A. Roberts from HP:
http://dpdk.org/ml/archives/dev/2015-March/015504.html

Sergio

Re: [dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

[Rapelly, Varun]

[-- Attachment #1: Type: text/plain, Size: 2576 bytes --]

Hi Lee,

In following link you said about BIOS settings to eliminate RMRRs. 

http://dpdk.org/ml/archives/dev/2015-March/015504.html

2) If your application requires the IOMMU, there are BIOS parameters that can be
   configured to eliminate the RMRRs on a slot-by-slot basis.  (I will send instructions
   for this separately, since it is not a DPDK issue.)

Please send the details for the above configuration. PFA screen shot for the Gen8 server version details.

Thanks in advance.

-----Original Message-----
From: Gonzalez Monroy, Sergio [mailto:sergio.gonzalez.monroy@intel.com] 
Sent: Friday, July 24, 2015 2:47 PM
To: Rapelly, Varun
Cc: dev@dpdk.org
Subject: Re: [dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

On 24/07/2015 09:54, Rapelly, Varun wrote:
> Hi All,
>
> I'm not able to send packets through OVS bridge [with dpdk] when iommu is enabled on HP DL380 G8 [RHEL 7.1]. Getting following errors in dmesg.
>
> [    0.657681] IOMMU: Setting identity map for device 0000:01:00.2 [0xbdff6000 - 0xbdffcfff]
> [    0.657686] IOMMU: Prepare 0-16MiB unity mapping for LPC
> [ 4458.091522] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault 
> addr 1a633d000 DMAR:[fault reason 06] PTE Read access is not set [ 
> 4458.164541] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 
> 1a633d000 DMAR:[fault reason 06] PTE Read access is not set [ 
> 4458.337565] dmar: DMAR:[DMA Read] Request device [0a:00.1] fault addr 
> 1a63cd000 DMAR:[fault reason 06] PTE Read access is not set [ 
> 4458.637356] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 
> 1a637d000 DMAR:[fault reason 06] PTE Read access is not set
>
> Where as in another machine ProLiant DL380 G7 [RHEL 7.1] everything works fine. Is it something do with the hardware on Gen8 machine?
>
> The following link shows the similar problem.
>
> http://comments.gmane.org/gmane.comp.networking.dpdk.devel/2281
>
> In the below HP link, they quoted the same problem. I upgraded ROM to 
> the latest version, but no luck. :(
>
> http://h20564.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c033238
> 00
>
>
>
> We need this flag to be enabled [SR-IOV] on that machine.
>
>
>
> Please let me know, is there any way to resolve this issue?
>
> Regards,
> Varun
>
Hi Varun,

As I replied in you previous post, the issue is most likely related to HP.
You need to contact HP for a solution to your issues as suggested in the following thread by Lee A. Roberts from HP:
http://dpdk.org/ml/archives/dev/2015-March/015504.html

Sergio

[-- Attachment #2: iommu_Gen8_version.png --]
[-- Type: image/png, Size: 114600 bytes --]

Re: [dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

[Rapelly, Varun]

Hi Monroy,

Thanks for the reply :)

Ok Will check with Lee.

-----Original Message-----
From: Gonzalez Monroy, Sergio [mailto:sergio.gonzalez.monroy@intel.com] 
Sent: Friday, July 24, 2015 2:47 PM
To: Rapelly, Varun
Cc: dev@dpdk.org
Subject: Re: [dpdk-dev] iommu Error on DL380 G8 with RHEL 7.1

On 24/07/2015 09:54, Rapelly, Varun wrote:
> Hi All,
>
> I'm not able to send packets through OVS bridge [with dpdk] when iommu is enabled on HP DL380 G8 [RHEL 7.1]. Getting following errors in dmesg.
>
> [    0.657681] IOMMU: Setting identity map for device 0000:01:00.2 [0xbdff6000 - 0xbdffcfff]
> [    0.657686] IOMMU: Prepare 0-16MiB unity mapping for LPC
> [ 4458.091522] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault 
> addr 1a633d000 DMAR:[fault reason 06] PTE Read access is not set [ 
> 4458.164541] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 
> 1a633d000 DMAR:[fault reason 06] PTE Read access is not set [ 
> 4458.337565] dmar: DMAR:[DMA Read] Request device [0a:00.1] fault addr 
> 1a63cd000 DMAR:[fault reason 06] PTE Read access is not set [ 
> 4458.637356] dmar: DMAR:[DMA Read] Request device [0a:00.0] fault addr 
> 1a637d000 DMAR:[fault reason 06] PTE Read access is not set
>
> Where as in another machine ProLiant DL380 G7 [RHEL 7.1] everything works fine. Is it something do with the hardware on Gen8 machine?
>
> The following link shows the similar problem.
>
> http://comments.gmane.org/gmane.comp.networking.dpdk.devel/2281
>
> In the below HP link, they quoted the same problem. I upgraded ROM to 
> the latest version, but no luck. :(
>
> http://h20564.www2.hp.com/hpsc/doc/public/display?docId=emr_na-c033238
> 00
>
>
>
> We need this flag to be enabled [SR-IOV] on that machine.
>
>
>
> Please let me know, is there any way to resolve this issue?
>
> Regards,
> Varun
>
Hi Varun,

As I replied in you previous post, the issue is most likely related to HP.
You need to contact HP for a solution to your issues as suggested in the following thread by Lee A. Roberts from HP:
http://dpdk.org/ml/archives/dev/2015-March/015504.html

Sergio