[dts] [PATCH 09/26] tests: Modified tests to take cavium nics into account

[Angela Czubak <aczubak@caviumnetworks.com>]

Testpmd should be run with hardware vlan filter disabled for cavium
nics as the driver does not offer this kind of capability and the
application stops at the beginning, so if cavium nic is used the
--disable-hw-vlan-filter flag is added.
Shutdown api test is also modified so as to skip disabling jumbo frames
mixed with vlan if hardware-assisted VLAN filtering not
configured (rte_eth_dev_set_vlan_offload return -ENOTSUP + there is
"failed diag" in the tespmd output).
Tests to be skipped for cavium nics are added to
conf/dpdk_test_case_checklist.xls

Signed-off-by: Angela Czubak <aczubak at caviumnetworks.com>
---
 conf/dpdk_test_case_checklist.xls | Bin 31232 -> 19968 bytes
 framework/pmd_output.py           |   4 ++++
 tests/TestSuite_pmdpcap.py        |   4 ++++
 tests/TestSuite_short_live.py     |   6 +++---
 tests/TestSuite_shutdown_api.py   |  33 +++++++++++++++++----------------
 5 files changed, 28 insertions(+), 19 deletions(-)

diff --git a/conf/dpdk_test_case_checklist.xls b/conf/dpdk_test_case_checklist.xls
index 67970e9e42cbec51c8bde0c2d7121844cb0cf2f8..0345762f0c894145ac84f35bb41467462f443c6c 100644
GIT binary patch
literal 19968
zcmeI4TZ|l6TE|b%%`<WA8sB=xcI=enyWO^D#`gGbk1z4~e!t(^HQm*oio3gdyQ@9+
zY7t)8Ji$tfR$`@9B(x|GAS5mVg$IyGctAWX0<E+X+3=7cgg}7gMIeZj#QguKu3vS}
z`VzyE-IRT*>U`(a@7%ucJEtx^fAiOKKK$MvEc!^Lwq2@IefGFd^(5pOoUaJu{Yovv
zIc1+ce*8ET<Mhkz3)BOj26gSk0CpjCBXG=TAoL>iA-sez6X9iqSqQTc3<Rivnu9PG
zVIIPKgars$gaL#>goOx;5Edi6g0KW(DZ;A=CIWSbVR>-AGB|#Ly6_8K)pN?lKM!N^
zx~k$>R}U}(PrqfMG06^ink$q3;%V|fDbJVX$35_*zG8Z^|NDAj#Xa5XPiB3eCa-P(
zBh{gPzw15hmHK;x8>&X%aL_6j%>S$HfUbj;VIAJZB(o>egSn;yv(j7G&sM*uQ~p%%
z_h=7<jAP2&jss_<k2=SYPpNO}{cCzZ8~cp<V|~q!v}72*=<krLSA7d*P&6ZRP+6+1
z95n%3aMUoo*Iy#(@h|EeIP1>r*D1{P0#i}8B%8Y2xMsbX^U79tV68T+^`bhemUg|Y
z-lnG>x2tyDDu1Xw@Z0J?ADgIWxV>vq&gN<Pe>|O>eb+AkbaGPL<^S20zl}aM*}Py2
z`+2?J50BFFwbRIR)5zCNBkyY~?}jF{>wn61J^x$Qhw`%-Q>jm+yeG`h$zN}NyOfr%
z@h9~_{_PHUg@@`fkNpoj^>NO_9(|nquuC83J)EJB^B;EOI1B3ofKR#gid8m8ZfjF~
z6XyJHTtmS5oS(F9Z<vzzw<RPaluYePNH+f}Tv7)A-plkND0ShR8TBvf4K7R`O)#VC
zd4%ffRSOq3T;MR!5E!V)JchE(YUU$W;?GdQUiI}17Cyc2X2!4|Q%ir$r4E)py;uVE
zVrkR+Us(NoqJCvoA23y<A$P%Q*k;wL*btpQ5A3O<2eFd!toj|>L;B^j=BZ|7!mgtO
z3T~xhSG@*SR>LFP^IvJ&O}l|h_MbR`1(IhsyjrDbR$b3*G;1}t?wQ`C(=eHUn%Lf?
zUH2Z;?0m^7dv-miRHIgRs(0==<+7b~>Tb2>R*N}bSaO?H&vL3cZ_3efmN1E`I)&B}
z*a$4?O3pny?=@@Xu!yfIHDT2~w>pU;8o8P~W!L@EN~oPa%iGo+lpe<$HK*=)ErNUl
zHATi}sWMidrLuiLXzxArxnos5r;xjAP1$8Dza>%1|6(=J_itbb-F&HzaYjSFY9B()
zUO*3E*<5LsJtyw*Mt*o`{J@(^MNRx^4gi++t@Rr}P>Dz4MfAcGRTst$MR%cA4+34V
zUrhf$v1C|k<3Tkj6xHyi+@yWLbKEOi)qKONJGHOm3vRXK+_~~O>XxvuNC6TS15MQB
zc{QgPl!leh^NvACJL^=>22ETYk8D(adj&+#l%48bG~MzV-t$)?=~SX36HShXs9@c5
znw6Y?$PWz-55p}tJhzsw!$HDLUHBZeh`eWODR7L1NxN{j(X8b42^`t+&rwus3AkG>
zmEEa=S1;$?QYl}vnhm(%sbb!(jzITgx7)UdT7iQ}U{&yNS3X@?rIM(KxUN(RwWV%V
zi*6;)NeOrVzWP6?Vrqe7)>2HArJ_^M({)d|^<utQ#~3-adt0z(E!Ay%qEW;%0ZvA4
zqy1boEn*Z886=#&MD}zEqihqaQ*~P_^b^uX*@vm?!m_4M8pX=tNy8PX+B6e2W<4we
z>Wv2U+OweJJiTi_&=U_<5l+eXGeIAoKHt6%vHGb&Q*i+n4xa0l8|Z$oP%AboH7roz
zvg`&|A~ay9fx&BF-Q;`wx?4aR%Byf<s?@Ant?U$#&8=!fYt~jwmvzEwI0d(c`x55H
zBcJxfvTGHoL1;t!3>+=%4m_@7+xGC*?c4Kq)tV^V=$wReK#PLLjfe7R-SfO&5nZB3
zFmDxV4xV2X?V4RJnr@Za3f(s+r^4kKY$@^#uv<1NKjnCnd0GYLhN4}v3*OG7SN0DL
zZQikEcw`h6cJ4JMD|TfVXQSIkH&oG4_v{VurOo^3=M8rXg<RVNr%*s|Z5}Zv9IyR|
zW2nou3aw!j3s2}!exg}#cv!&l97^M%5W9hAeGOE*2rUk2wp}zUR<&uB%MZ+Yv$_^p
z(CGY@<Nlflx&RIE@=i6sEss86LdCjIM?$R%mSr1aV0sD51?DC$Z0)MsyfbO)r7yKm
zs~B8Mplgi>SRrFFEubx)YqQX=q9eo8e3ZTnW?{pz6z&$R>I1i#voJNg#oUD3EEny1
z-NFos3(+7n9Gb586{~R<Bbum(PBWn@rr#A?e{vIY+VbiZbQj0jEZX<%GPNCjYL%^e
z1<K=8u{N(aYhDAUOJmC;7w!fc93J;ho+6|`1!^!#9mQyI9k0)EJ8-w^fTxuZDfciR
zXm^0;uhF@74W?347L<Y2r#B5MXO`-2#XRA>(X^_#NqJs7h!@!jgNtY5X`I(7r4C;@
zVLqu|x#4l%iNO6+^`J&}-7MB&2z3*o0oP%AuDNyN&{o{Gpg+*IO3f+TCc4(G#}+j_
z`WUx#RaNL+fPg!)VB_;>ZXFm9<v;A|7Z1B$#$`p^HS*EW9DP^VkNdw*e*4EiI5}}<
zUtY@}@}@P|R`RA-<uYGK%6nbw^cCy%{+D!Ktd#Xb@L$%lZ|MChTwl`LKki$dIA0TS
z|7qXa#QFEsYp6{TB;Mh6ptM|O<~z6X|HFOZF@r}y9eAYv3;MCVQtzyVkHp3}uR1n6
zj&~sEJ166KC+>Pb*cHdSa4-EqR~+xgL){NX<2dXyQ(of7RR`1$TX2t!v)&GvEw&!i
zQ=eoEEn_4t<6U=J21Rd?v5(XFU<xfV)T~7YKhz@Q_@#L;sTLWvB%Kd4O^Xb6+aiN|
zZIQ9B(meKKTE-qs%dp&Rk-?L-$oT3deJ!;xEu$%<WqehWmSN4+BEuBXBEy=gMaEY>
zX&ztwq-B`ET4a1Rl+MRjMQIsd9VKO->K9c0D=DS?SOykN{qtiT+P=eBCt}n&KdlQf
zYMUSHMvQvK7_T=_QWztXy5*;l8OO+sW28{yn3Ecx)vwX~Sdv1!G<5C#v?Qei^)U2n
zH>R<^hPHG+mZWrQ3boHqOHw)oh3z!(B+bvs=Vx)PyEKKmNlF(=Or|C4!u~Pz%RlDq
z7L;yHq2~H&NeaD6+#>d?p&#5cCm-&|<@IO^_1aHMQhEf1eQxN--pn~eP-bWfwcbxl
zQf3GW$I8&JEt#`dP<l0mHsPlwDZPS1e`4sDp3K=ND1Cy`CwjL}Q0RdS{o0fiYGK?j
z)FuP}{JKypl4;4_rOz_-i&s)+3d&4Pp;h{6Ny<!77kW8EzqVyg&MR?woHq^qI@eE2
zQeGAmYNnxI`ZDJ%L7Al~v}ivqNtq=m)LKKCLC)EN!WTP+S{9`xDYFHIeP>{H^~<A=
zh+D)pfT5O0X-NvbLae*=)`tERg0=1!lzvTF8BqGg81)MZt;A5Pf}C>%g)0$5t&Y-?
zb(te5oDmGQCdfHgQ05BCTv3;~f<jx%s<i=So}kPVlzD<OPf$4PWYxNW!k12Q@6H#L
z`GPWEP-wA+S|3mr2+9IY;Y`7vUmz$81cfu3p>jdate|8CB`YX=p&gGj?S4Svenyu!
zpeY-p7{@5|`U8S8pedVzoSZ!e)KC;-zl4-QU6+tDC@6!1!ufUpuN?ilEEIKFC@2dB
zWuc&Oh8|EO0cDY(EE1GOg0e_Z=sgD1=76$TP!<cyVnJCfC|m^$s4W5I6+wALP+k#~
zR|JLHFrc;ulqG_)L{OFp$`V20N@GBc29%|OvQ$u(3d&MJp(l&=<yB1y$M#iC*%p-W
zs-V28DfHT0O`A9-S2&c>yQO9HV`&-vS6a5Bjf@^DosYgKEu#-g%jj*=GWw3RjGiDZ
zqg|(Ew9>SUHkX#sX3{d+SXxF)OUr0CX&J2`Eu&7SWz^8LjQW<AQG3!dj(1wNy^U-~
z8`;h_vR!RtyW7b2w2|#?Biomf(XX12#s10^T5Jj}HiZ_OkrtCejg9@)GC^4;D9Z$8
znV?X|V}Hf_;@Ic%vkpUr7WJB-ye25Lir8N*7nJ3KvRqJ>3kvNh_E#$eWrd)u5R?^y
zLd%Q&)k;BGDJUxiWu>6dR%3s)N>Ek_$|^xwB`CD+tfD@0#8wN+YC%~oD60j9{vfNU
z!KADalr@5~Mo`uW3O$ISsPm+()s%3ST&pReCtWKjYc+*-!RzRA3`L9ZW68OePitcB
zStls#1chG8P_!XZ){DCEX-`a9FDUB;g?`OYv^r99f|3)IoS@_cg`Ut*v{O<x2+9UQ
z*&rwz1cg0msIh>uQBXDt%0@xiC@A!{hT0!cHVMimLD?iIn*@da*-!@p%8;N83CfV5
z3<(N7x}gpRlwm;`7L;K@85R`I0fsshP(}o0L{LTqWkgUoYh>{Wr9VcSH6_&6&6;vJ
zN=vTgH){&#eU2^XnXDR*Vo6`OMN^JMX-Uc!LE+4l#phu@bE~M!R?(uZqD5OZ<ydeX
z=duBHJc=djGO8)zDtuH>Mm6O`a2<W~pgI}Fl9X+tF55KaRFtzD_rRxv82!_rIupf`
zl<k7DT~M~8E-{7vX;7UFC_6;I><}&5AzHLU^e+9=pgI>&b_&W)LD?xNI|YT_YEYdI
zD7yq@muL|`#5YvfFS|sG=;dN-+$|`(1!cFO?ADYELFx2zu{G`yls$s7M^N?%3cXxx
zje7-Uub}J|l)ZvNFBe<mK0(<hDEkCuUqs<rc?^{Fnu|UwEu#lY%ji$iGJ1!!jJBSZ
z(Z<s<T60=PD^AO3uW1==F)gD-re(CYw2U^FmQjn+GTK;LMoUY}Xg6sYtspI<PN!wm
zw6yGE8`-5cvde8`SK7#~wvk<HBfH*4cB75#W*gb9HnMz5Mn66V*#O?p_#SvnXz`fP
z;xVDcV_J(tuSboIXM_EMvR_j|54>Mf!ue*uri60}bvzrb9u5e~0a2F&qAmwSU1$}t
z?>s0d2Q`Ib$F?67l!JmoJBoehAwfALD2D{)kf6}=;x+5*pk$+`Ft3A>jCCSLt<QAy
zV0P|8jCFh+ysV;TF-EJ6SFeW!@37z<My+Dr;fQxw@M!T_MI9x5T=2#PZ(Q)kBi^{+
z(OYB{^_#pSf_FsljtJh7h<8Nr=xMTwwn5%e!8<B=M+NU_#5*c@^io+xyCUzH;2jgZ
zV}f@q;vEw_dbqfL$H9wN+sDB(@Ph=utmEJ%(~?i_=o8~woe-20f^tGoPM|LF^FMmg
zxbII2%1J>vDJUleg&H`Z=uy~1rv&Acri8Y8N>jqw{uC$+6}=9xqhE;q!D&!pO+O7v
zGM3cS(@{U4*8NP6MIOC;HoD(BBY0;7?+j`c>;0LCcSi6yLu8{nud{-8R`AXW-r0zE
zR`58xWVJ74ZO;kbIl((8c;_PCIl<%16nnz+f_Gl<&I{i8h<9G_IICr&ySod5cR}zj
z2;PN=cR}ztUu4y7?AhLn;Kfgg`K~`6-;3bIdVdiVLxuOh^uq>z!s1gd3Cblwxg;o;
z1ckmatKadnE|&%6vY=cRl*@ubADC5zpe|Pg<%*zO5tJ)}LeH1gUqi4iR|Vy&pj;J{
ztAav*m&H$K{C>G6DAxq#nxI@06neRAbU$-lP_7HgbwRl<DD+=hRSN2ILr`uA$_+ue
zAt>}G27VCax9Fyz+!U0Xf^t((=v}hWUC}K;xg{vK1m%{X(5GahyP~|H@Ee*~ck_ah
zk0@NX-v%YUPNXI$Wz+%Y%c@E2{aA8_xQ)`{XM(pyX}5K0;mU~QEPmqUQ!HKQ&<|UJ
zVhM^BQT`P^6mJb5afZfMLyvlK%pkzPA@6+TKj-MuzeCBWzDNB`OKlzMC4C*Q=|<Y#
zj=Acc9%dTjF4&fk$5)FipdbG_I_}_yDEz21-0%Ste+J0tO9)@2Z=L#{>RTtYHTd>O
zcMr7Ur}ym<^^V&>^t6Tp6Z>RT6|r!A&R-cN)9A0?z}2KsUk0LCm|t$iIr;5ZOvwmJ
zMr&b6p<)a~b1zgOLGiybxf_(npHRjn_+OcngS1Xf8H-{`ivN{K*dl&G7E}DMOv1WA
zkx>^u4`BP+ePt3-+I?jbQfLbUk&kTml}Tu;-J&l3S0)u)owQCfX`N7{XSPmU6ImzN
zZLHH*$_&(!XFtc*sk=w-k|Qvb9D$dgV+3%`6Gp%<SUcb+k3d|@pX)RBR`@p<Xt?ZR
z>MxCp^1k30|HAysv!A6N$Y7K^U&8O(vGw<I8d2(9y;p}9<9O03)ZK<#^32!o7wodR
zW7~!c)`X4UnQApT;FL;yI{(}o^v^H!ISHR(!NX}Xy-}|}eDgQ{{o~V<{lD{Ty=wjH
zKYX9dv0fz1!jb7U1YUU`fm7c%5NHG6LZBVIg+N>QEd<)bA0c2K(EUTZ_&x%<PW>$c
z7nT2j057E;A+U^35Xk@MPyN4n!ZNunMR-x?<n!gz7=rpy&!4lN`kZlWW8A&_wOPyG
z|BDRI@BjL(@BZf7KM0G*=(q1bayx$bS3i7f<Kq5re+T`S`}lVcLDrp;@m6LKfk1|S
z1YXNFPbWw6m)rl79(a*||3!~~%7?UT=4%i>q>^B}jK615S9kHKfq#dFi_~Y^_=zJ?
zv|IYHr@5N>Ki=)<%;15wt19pXr%?wkKA&x4`Scwuo7>Y~&4;kuGAOsKA4~Z0XWjFY
zV83L4|1{UL{quv2-FOMvMEfgvWW>Mya}>X!Dd{nx#KY~etN*~kbX<Pk!IJ4Od7Lg^
zQqKO`9(bT`yn1)>h=_HtQIhwJ_2KJZmK$!#a;7_{5BH`^d=7b7HjhtpdGhb?JWc*5
J<@r42{|~TFqW1s*

literal 31232
zcmeI5d5|1eeaGL-u6AcFS)*IBtfO^bD`_vSCF@wtN?J+w>Xt3pI!2@29%-!EnPFyD
z2W6K<fPVr3BY_=kC6ogu2Lys~3?xplQz?!rkpzO{7#qq^;NnOHa7ZOkn92A1`uz3u
z%<kI635k2_%}oFLz0bRT@Ar;=-TM!JKl!CcKQ;T?DsXI34eD2w7S-gFNAR0YACr_?
zj~_h$Ri#p~gi7J(o5ycZ3A~E5-ipd=fNO*s2gf>ZhKs?qz})~h9&Q5Mjc^m;;&4y_
zH5qOS+*G(}aMR&tz|Dl41$PtNY`B}@=D^K`n+G=^&VXA0w-9a-++w&Ta7*Eq!7Ybd
z0k;xv6<jOaYPdCUYvJ19+Tl9jI^nwD*1>hd-2z9wq}%BG{Toy@Z%9%PsyzP6sEZvc
zhwq}ggwh)QF#{UoBs7X(MvR|IJ*_`gAHRz4`|8CT-}}{waqh$4nY-m{kqwYtw!En$
zh`p%Jsna?g=d4g;_?)7m5$dgzhS3CN)GymnjZ=rzuo}W&O6PqyN+GS&L`hj?@H<xr
zx*YM-2D1Gy4RySVOJB0j#;NUyVL+$B)HN`+^sGnxPTofwKg;W9cKj_dwBn|5>SOc2
z(){IjL{t+lep^M=pEW*%Po=&CcU%?t+jt|7UY&+iglTvh1-v=Zq#}?tsB8F~1iQj3
zsC|4+)t{f#exK5xn{nkQsJmx3+%})R6#J>8(XHCw@958k`g0;aBkD6c%r~^89oFeZ
z_>ZXvSglcYr8%+<nvezUG&Cdwi}S|#n60QImHVA^jEf|6{7g$bY-+u$qfKGUh`F3L
zf{zHS?o+IUnk5xMA5z~(6upI$%ka`}MBhRmsHmFtF}W_I6|HoA-E=gL=;KA`N`1zQ
z=tC!rn9?nEQ%ddY8qvq55qv~cPu<*}4ax10t>GzK$0KM3^=pn}gW5G`XdU%hQY>;v
znd%Jeov93UhuW>?HO@i*fw98E#S0g;E?U%<T(R-^a_8juig}F-FdD(Q!4cv5v4iH|
z3F&DehAS9YIG)zDNe<45T88W_4EhStY_GRq%z;rwl1W)<I4QGFk1yAP<104Wf`zLW
zB3;SlTa$=o4TdZjv?Q1N!>u&@fmRwKL=Ofw7=rmDvvMHg(@FD1+0)}i+KurMMnZ0+
zPIxz7C$Ns%A9A|-2*+^??=njZH`<?j^9$!S&Q_0cFt_k<aoEHa`>QXNEt$AFO?{L@
zz=ivAxMqE%(~zG~e~8>fj$thKabq>g@C14f1EafExJ4MTt$}M(NfgmWbxa+ECJbsn
z%W+me%yEQyNslp=`uB=~R^l8_8<caz`lkHXR}L)Q2<px~qJeUL!oJe@AzA*e{7-Ah
z|D=Ze6E)<I)R2F&hWz6-<iA%#{;nGGTIs39|Fq`BP%K&x-E#Q-8geT=)&8yYRLeh7
zgY&5x@+WG@|GI|!w`<5hS3^G5^!&Nza7HQ1$I=tdGPV5ulP5nk{-N=z@j>mMGfzvN
zPJe#>=jW@&&uDowY@U|?Cp_rG(a#k%<gGR2D?{a+?P|U=R8|(BGvF{eXT@6X*1M(W
zoGEMh*VTUf#KhO)!0P(t$fhOdjN0~Z;3t9y<bm{X_8pcU&d9agEl;bxOmpO4SEuk3
zlXHvDnY;GyrvGEQoVg+p#&34y*CtP%F@6T>>tXGmvwtUEtG=vyY{ocH%LDbrm4Yz-
zEJyxz48PSDx7@g*5ayrh)b=XCr~J_dL#cqAs~lneA%=XpwY<R-+wO4{L;GjL<YCMC
zGiWF8jZIVcI{xTE?NrS>ziQkUTdnRBa$bvKRb`r<K}L9LcaRe?GKy9QpqDWPum<O2
zh=EhtF~z|7<d_1mO2!m`bv32{RL(I4V5N*H0L|E#0?@vVDF6-Mm;%sZjVS<4*_Z;*
z#*HZejbGgWi9maxRcxr;9yk$fP-dDc=L{I{iv=Mxp`(CM4QoSaS4RP%YSxC(2#*3n
zb*&Ad#U2HODqI^v^F9g))w(u>wtYm%_5S*`LxVpGNd4Mj?=T8T{n}wyG73oj+F`#i
z3P}Ch;qv$>AoXj9>+2o_C$cZG+D=Dj{o3II{U{*yYlkcRqkz<}9o`}s1*CrM7^8#K
zubl;>gVe7bEIo{z9qT4c?FPu(BqNrIbr+{LWbx=A^=oIz=pglLXX)r5^=oI@=pglL
zXSoaEc<GvIs)%tI+YT>OzW8?)uVCL7=)6|IN3-s{==T@*sc^_Eue{<ynr-m?_upS}
zR!Cw#nPDF-J{j2hxFJM#Uo4m?-aWGt#etnZ{3A>!XOBJhSXH8WdU~o7MOiRWlsRlC
zQGQwVD0UUR*BuuG$H~0+H>Lo*Q8=amysJ2-0BhX<tZi1HP?_pXx48jW6CB<J0tCk~
zSkkjwJ7d5!NXFn)-4}lBSIQuScSk*wp>@Dt|5P>#>-P%0y*eVK(o-MOH5y2;e+nuB
zZ}586RF$3TQs>=ZF91j3fl?1P7~VSeT5(U$`S4P&T>oHIgZcHf;$SVVN206>2sJH^
z$*5e8xQVJB7xTue2f1d}(5K3euK6Ir;^EzN&z@AxSRJLTRIa-a$H+bY_~TXfgtDML
zp$xI;!?7oRS+$Yd1i$_|gFW&qxs#|c%lqGF<TfKwp5|4RRJE#Z5dng_9l0-dN1(&$
zL4d~Evn7^$ux<O>yVK!Rr(~;}5~>?2LzZWCfbDJoMi`RU<$<K{(B8N#p>3NlhH7|U
zefZVr6x_qWWVWMiiLu&93=EjLa{HCo9(9Ey2m6RL&a2#rI}&Z!V`5+*iJ=m>?>>M#
z5Zw1*nc4{M-ZeLx=@-8D)5<vh))`TiC0vVPG?RnTbW}&Puue3VG1k$HGt;kp^TqIJ
zrUawutd3@BooFm`t)po&(?9&_H^ZZu8jPl^I+~SrqOlCRj;7g6fA6J#36Ex4Fq(DM
z(X6Qx4NZOnbPDwmL*4xAzlBFLJs3@Qbu=AyqG3m2N7G`aU;V-J;nB=sG+p&IZ9byu
z8il4^@Bi%e?}kS+GZ;;XrY))yjbGEQ_rLtP&xS`cD;Q0PrY)-zjbGEQ_doaDr^2JT
zDHu(Nrmd<IjbGEQ_g{bd8{yH+4n`BAX>035<JYw7{ZD@L`{B{t9E>JJ(>m)!<JYw7
z{l9$niSTIVFq-cAnr0xH?onu3N9PAV{hSpI)SNqoT$?sG7)^+#Ev^%dU(-4|pMU5B
z;nB<sMiZiG%j-nr*R+n#zxk(!!=srWj3z|WTI)pP*R+n##~=M-cr->Znh;HEs}qf1
z(>gk@e#N%X!Ma%xj3z|Wy6QyZ*R+n#Up)OlSZ*d@TLk9mZoiob^qX@l%{BW<rS`q;
zufm~=JSa3O2wf0>`n3qRr1tL#hc5P@(4Qc5NdW5C8KoZi%e%s%OFSsFB?w&+fciB=
zsmp_Z5Ds1HL7^K#=;{E}uMbMy{_!t_Lzj6_XhIO$9)S95U#b6iurCZ6!@Vwy*?Loh
zS7IAv%|~voG^k$8I|tpaaU92jSOnqdh`+f~Vq20)*r0()?Y2~QU^ts9XY#o#vA0QJ
zbVg;ovbNK4%VQR3Z;NHK?&1mMFx`oOt0+2xChR-rMb5DzC<gyoOq{idv#ZfKcJpA~
zx9zMsaL(9fX0umf_XpB7vvLE{bryrc0c=J!@Y_V{vdFfVDz1>|L7~5qI;r9;qRCB_
zb>^hXI&)HGon4JKs#TX8Dpz8LOv<<hM6wNgq^v!uh)dCL>*Xf+T^{h;gdO^xUjr-m
zZP-oYgjs#L5n+}F!ZcQ52s4bmghf5}9k6%&GL|)$n-OA7AVhOzLRAPE*L3X1#+{oT
z7Yo@`E>+GKFByl;i{&e^oe~vYSDA#3#uu@nly#re_0J8!mr&-1k(`Ur2Tq!t+Gl0k
z>eZ;)F1H|cw+E0dl_}U}oY&QrR~G;o1Z)?O1^g~To<T(CTx>IR^s>6_U|TTs$FjxF
zd>;D0QL-bmD~-5w%N^3P1#rd1Nh0##uqI-9fn~;BW@<2#J7Zu963BnUBvjZgB#TXo
z$vT6iT2l|LS!jpzci(5>sNu~>nPp$EMkivAyAKYN8iY>{fm>#^2E5YqM^AqX86mvO
z4~J<D!l#75E%RCfZjCsi8otgChlvf?nTDw$aGF_55t{wQLN)Ea9D^bRAkmnH)U0;B
z^5YJBZom@)xQDSjR~Uwx4$FFvPD7z^CwKwvgbL{y0j~NuHP5A?*J+w2VM8hOu|JbL
zXAau7DX8GHU^Dw|CAO5?vrY|eOL6U_V;Q*=)P&NXpf(`=YOgt5E~a4m0-Z)=4myp!
zP)X*r2*sq)v!+4X)?+Qm$?r8R7`crRZ3uPHDGM&55anJpm!jTKPn2DS5&T5YVF$kv
z8y+z=-<vNErLsoH)o2U0147sL=F8@l*l7uk-hfs}Xc?*Gy$#L;b=t7R<k(*>4|%<U
zb>`S#>&&sg*4fqQc(qC47RSEfvQ~i$fk>wVy-ycPwG#OICz^Ai1Qd8FvCf>7SZ7X3
ztTQU~=F8(yn2Ti+#*IVG?AJETS*2hZUX9+MworEuXUbWWR=W(<5J!C-hPsqdlPs_5
zHWVSEM<eoOszhL+q~RuwV1Zle(5SUcEQYY$9qVM});XijO;%e`N9stbn4=-I`hp&r
z(CBz{D@PDR5e?0;g<*XFM;y9@-xE8k-s4-*c>uYajK9NxoYuKLgd|_mzxE*SG_icP
zV*^Stqt0s$@_evKok5q+wV!TvD#B%`cOqBkd+-CAap<gRmfI=$Xxb;~pybp&K1t`p
zv03V2U%D(^w^qSEjOQyp?7PNr?}n;J@b^q428U;&eiTu^RE;;bAPGab4l6&9Dw#$u
zHDp4x?-1<Y-rd`vtmRbkj9CV5AU`yOMXnNzT6@R(<XeW#VY38piT-|Uen@A|o5}KU
zA!{bnnQYlC!o;Mr=0*DqJ@q}qL#Ok}bP+KmOPRNtSYA%&i{<l~EW((nGg-6MJ1-S7
z#Z0+MfPgu8oQ^~fXUiEcwo<aaZD;SaF!|12q_}h`XQu?)L&_KO{*+Ep>O95}$x^wP
zDZC{)kk6$vXOLhmEEh6^0nvd>?tl%$eZX8Ml`CfkTF<2}nAudatMzoMSkC9pB3q@_
zLjHnT)Hy^Nvaq;_Bvme<w2vGx_M$+{B6PM?&KHtJ6PJo*6y*R1jiuqCr2c^n<NkOV
zR|`XfMlN4AO2dT$3eG5>&6EsY;PtbpyUalKb=E4fTqtJpD9}rGy0Hr(oy}huC>OKI
zd^(*hq=rkVxC?{Hd=A?jylXjeX+A)1j=UU~K+m1g*+j9KNK3JNso*HW_Sas|t&*%O
zq?pPL=7*BZ_f)6iF69s>DnU!3c)noR`H>#X6qD4&3;E(;a<GWP&J@mf)x6R@BN&DS
z!yvUTbhA7eOD<m>Pn~PsEbBlxC$8F;y0Phk^_?$;S2udzbkQ_Vmj<y<#H&hK&FQqz
z0a4HC^ic$SjcwDX^Pw7o>VYB`OC@N0IR)+K&vWJ_Z4+Q-GHI&;+L_#UC_IzsxeHJ_
z1c1Jk^Z9HE*)9(h28V|Vuv%!#W{IYX?JZM+Zj_cg#-W%Wz%|4-MEfyRNEHg%%z&Of
z>Lxf`SX|5N=~O8*kS~};?HgN8EHe}&X7i~*Dk$<0?tyxeI)iqZF-^05-TL)OGnYCI
z3n+BAHB-#z3i;fi-44?E;aoYD$+ea*WVHNVrNXU^&v1^-vie)xh|!-9v3{>vZG3HZ
z#E9Ri)ClJGjVS>1oR0Z_L-LKW)f*De))DReh*gw&9Z4Obk8$HpypA}WrUk2E8xR-^
z9dR->P{?3&+@M)7bAv`cM?;HF$2fbz>3U&T-A)?aC!2fnLZ*B+$sP*Bi9s`M4wP@*
zeKgV5*14gpy`$Su>Ov}0Hc)-&w@pLaxZ;qJF6M`f{>(kYsT>~pea)5YwuZ5^qP<G>
z-Pv!9l&;qHog7-AvoSGW#Hhh68iPd)_lgEw32SafId806)3y#}nK@rNJ7f-FeIe7m
zzI!zmX5eu(Mn1zAVP;pK85n2{y^t9gfGN)whS<+`W2R9;0T04{c6J!2QEpY^9*%2v
zI@Z!PjIXr-F^oNz%U~RZPt?s&A(J%?vsla*y-IBFUV-?a63MRHtzj(s5cC}7WG0uq
zB?%4Tg`w0%cDd}0Y}0^_+{pwBa43}<PGz%~jN)((<3RL<$<xEdQW^JM_#28*MroO)
z)n2gRn2&j1%Mvkj`QbBX4LuZRr>A=~48iQKt#k<^b_{A+wB@|Xw7wPE>HJK(*B77{
zHZd?7I5&{WUCIx)rZ7a#54N7p4`&Ba3@HqP5fI5n`p~iJ&!JT59GZzQ9r~J9aVx`E
zV0LmImW5Wk5ui}mc#J{wyqRU^it0~gQ^g^)$V?7XiQ;gfT*63!eR~qVFe52ZTk>a;
z6yXX~u7ELsK1HE&II4exq}w!P=P}CF;|^>ncYo_KNCnfun0h~S79{mDzE9%&u@20V
zFjG2!6{j!bdp8z`p25^;JaYAR=*tAGbiV_mkPG<!F}{1(EA<zsgpb^cw@x6wnVXb)
zFLLl>e4oLf=gMY0xrzw(W5>mp@I5{@1&(i>Xi%pR-w$5JhZ=~@fa5Rgz=)HJ6qr#z
zh*{l(zAL@oi>OB+d&DP0GS#~wd$&(U4w9j)r|u_-r|!o`4PMsAX?(slf%NTB>Yp+G
z+l0<$eVT9I;PdJe@HvPFgZO(gKKZChO#SkYfBLmOr}y_HwPdCKT%|vM3!f2nnJX^#
zu>@-lc%Me(ZMgCb9_F;(+wpeo`yKjoDSW5(@p2CzoOOOLcPZcRS>gM=M}5nIzm9Lb
z%Ax5+gm1u{pEKki-jI(C;yaF~_n8NNVzmr&`!fExy8HSM))NnYlg{t3Hz_=dyJQiR
zJJZEC5gd&kjdtqeAA6kdh`NUL_G?~2gC&nmTr<_j9bm-NeOk|zdU6HpQ|WW^cTe=r
zqqy?q9`C#XTKd99@4OLO`9h<2J`T$@FLZn7Xb6#^xftN`z)~-d)A|!vR4fW3g`)}j
zpnpW-TE>&0j42Gt(EO@o)UKdEH2*3Y;}80Sv96M_K!g6!tgB>fTS0$l?o~3{mY_e_
z{3;pCD(H{p7?iODgEA~0RLNkst7MosSIO8SgFLLWRLN+Og8nd-u9BhKtCC^LStaAM
z3_%_rO$f>`7O0Y;!>*EHQdT9yx`mLvsx6}RMj@rFGq!l@pLG`1w$3?gz!`PUy4Hv@
zmX>uk4rkOoo-ur!i=6funbbGy8kyc1ncf*GEJgaH#wYY!i>xz0h3zt~(3RLe{S>ac
z#`PPJ7>?<Ua}{3u<m$Q?UxTKgBeJjgDO}$7D9jn!rtOn!h#sX;Q@C`=_!<$T|C*n|
z5{Yw-QTya-y5|$S+;GNPBW0YR(5iT8VQIzn9%lOFyIDL+lcsF7DNTaXBq%JAxVC_#
z@Ggr-Y1Wj4O=%XCW<g<z#Pyq|NQntbOjCMoN=#5<g2EDsbGwDkdyAm72uh2fv<M0<
zP#i177KK{q<%rr8$HKdF&0j|>ZLf4`v*P%(e2y2C@tU&6z2>Kk7Zh5#IPc5q98C}u
zjv?YGE$5n_g1alYMw`L%WQoKv&T!8BIpTOEuHXM<`Seq66cm<7T)!oZJ|~K_@GU%X
zwcU<kq9|QH1?#1SB@)-~7$b!?!Yf_&cX8ZYw$e!(;lJjmuteheEoG!k5|l}zTqX(1
zB#{=DNL;_$jFicO!ckdVzwgYt=1<FHL1B*&*KbFo&nbe!w;OqsDIzUX1ciObHoRlQ
z%KKD7;oFfs%2Yv_Dk!w0+w>dOn3idR!fm=9h1-g~(w!zK?5E=T{cfa87nJFm;%MD;
zL76Tn?AhYVz$Ym)1Z9Sx%n%g5kId5-TJc_t+bqgVO<CohF-MNopD8FaHD#sklP#fF
zzoCw4nI$N*bXpwBEJ2wiDC}>0@s1NKEjI}Y-)7~d<t9P7Nl@5B_v*LgF)gzNWwxNq
z7L?h7!aluMzh{q>n+4@&LAhB_ZWa`d0(voLvT`&>Q055A96{kbf4C>d3deCnFQ2#9
zH9c2Q<_gMOL76Kk?6Z3L;vG$yCn)m-WuBnS6BLe3Jbjt3DNfza*OYB`4D$tLzNS!5
zo`W6R3-g_g9>%Ve*Z#**xdC2q<h39~M*R-@TNEOr?gjlV36U)gk+GJ8VOeKE8EYUY
zV@(HTY=uD??N?B?Iz-04FX(S=h^#F{h6RPHuvlEEl5v_AjH4?=h6RW!e^`X5lHC#_
zTOT6Z5F*1OMip;khzyGxRsJ|S4d#Pm&7h2<62FXg!GO%OdxmHYhG-3jXbpzj8c3nW
zdUkJtpezuS1%k3bP^jac-Q!H$vzL6AUmQJ`)%F((%0fY5tMKgJB0*UsD2oJTk)W_0
zd3JBHpez=Y#e%X}P}uT3ySGG8mI%rcLE%;iuZLq>_3YkKL0Kv&O9f@Aps;ms)9+Me
zjV%+DWrD&LGOy&92@37OHtayO>S4K{;60hXI^vE~kFs1)XhGt7QykN>LQ|YRdxfSr
z7I}rBtk4v;Wrm~8iR-t*T4&T3hr+cnFZPv!vQkhOB95(b7IT$I3)j{>$|^xwB`CCO
zas6gmrUkD@!<mzoRzYbMlvY8ZC5-EL+mf<cP*w}dYC%~oD72k%{dQbZ)(FZPL0Kax
zYXpVXHm=|QOv+k8St}@O1!b+EP*dXAonw`5o1nA_N}Hgx2?{NGoG;MR_1-Qh?Sj%S
zDD8qmy@_KJnnmdllnz1Z5R?u<VXv_b`^qdzr=~dC+NmkDhAgvALFv>KXU0W+OXyeU
z(r1^TbZN>Vo6;pHU4p`%DS_RqR($IOWu3^;Izd^dDZA`&?8|zw7t*413re@9+~8jG
zx9M(8xy`=D-fsu?@L7~w1mzZymRodM_PIX!e%yoh8T-o}*vn;6)(Z;WgNyoe%6h$^
ztVdcr3iWM=y33|)5R?rfM;k=BY!IbOecPe#wkfv?%B_NOtDxK}DAczd>VQqzC@336
zjy8%MZ4^18zIm;2lb~!8lud%NNmGv6v2&#0wZ_eYvRP0z3(96e;n>1!javj|i=glg
z^Kopkv}%((8n-JaEgX$_t+7W?dIY6MP`IhlqHr9(bv(!6uYC;8kQ|3^MQZ$GBgzsX
zvfdCGM<v0qT<HkPxNZ@Y^@YgTo`e3_R)aFO*r1H9F(|t|MAjc7+Y=&Vdk*qgpFtU0
zY*0p>56aligECsWpzLsn?2ZuGoguO#Au?)RFb>*>pp30OC_5G+J02oC5h6PoB1;Bj
z>;bky)~lEs>&!p)-6~qcR?!-^>ek>`Pim~!t0Y95N@$8>$rGC5*wTci%(7#rjwjqv
zNUxyuinR2KwDgL!uvK_Ac$=VX(-hVdbGuDYwh0Q`k!ORq3(9su*)AyC1%)jy;f{TG
zfRaEhTe0r|#edd-GirDw+Ju-JamF<6055@OZ>%tEwF!3=+$VT_g4c&sdAvTC*C%*v
z@d>;|*P`zfyq$u#Q}A}Wyq$taYmv}T2{G-v1aFt%?Gn6QE^n9M(b6RJU3&6%3*K(Q
z+bwvzUEXfNqm@c1wgd8R6TI65?>51^&E?%Dc(ia{`fdl$8z<ZjUR<5B<GLL@|26+S
zi#E|qRllJ03rfGB^dl|aY>igbEBifyvPV$%2+AHoq21+Ec~%MS6_mZ2;^^;QO>z3z
zy`XH@cYay2lzR4HA1I!t?*qku=GW7GZaMGM<vd`ggH}G_&fE42-hRQ`k5qYjzu)EU
z7d-Y533mo}K=2L--T}co;PMU#9_?Vlo%tLTyn}*wQ1A}Ayn}+rp2@R>hXn7C;2jdY
zLoV--;IUUrxU<B=f_GT(4h!C4mv>n3*dr#eU%}FnJHYd1o!ooi)$bkPd3t{bC~-W<
zW`$#~6W7m?P-pH0rO%za-YF<|g3_lgC#~b1NL8P1!FPh!=kjRR6Zj7s7X66e9TB`E
zf_KE_9T7bC-3dI$VeyU%-ci9jDtJd--ciA0zn@TNZQfmicbDMZC3ttayt@RCV}=Bt
zG_lfmx8U6^cy|ll-7fEL!DBCzaA#7-1n-#O9TU7`F7KG&v0q8x2^uSX#|7`W;2jsd
z<1X*G;BlPOr|z+NCj{?=;GGb>6E5$B;BkzUaA#{L1@ENbofN#2F7Kq^v0q8J^R}em
zap#oRDw2Yiba_da$2rEF3386HAM;b^&zX5R=lt$-uX<9>Cr%+<&e-yD#F}@|!uw@x
zf%KQqPqSKQY>$q$KZW%7VZ>zB<taD)mQS`qXB0<rLO<!pYbjj{4kaZhDM3l;yp!@A
z?z2CE?`fcJ!HaR8Y~n0*D;%~4LZ;Nau=nj<F)gq^da;iJ_hs2+xy|aRp6-1R(GAT#
z6Pu~{{D5;{vlsVZHDHLxQEB*oxoM7XT>?+R2>b*M?SJncIqo3it~>7Uia?*3NoVJn
z^NlC!$GC&c+0n)NqrUvl?dYN|@#xj{Z=Lx^TiASt`llc3n!nfKbDeR;u^O*MG=(dB
z)|sEey>}iZ0{!&*u85#SHHB+(q@c8YKCQhw9MxIZ{1j{N4##S|)}Sd|!LrW$6l?E}
zlOyiS^U`AN-Enf%s3}~NBPDF_jzbCCyW>#CX^La5!}jhttvGD&4o3vfVZXy16b##_
z^QYS{t|`0y>YpL)H)^$COVJ`wHT<f)rj|R&io*UZp8NmXYQ2IOV=Y(#*-&_lPz#o)
zuulTmPN?PlUwPCpR&cX@-eP~#8ozn`-z$M%RZ!m%YJfbb7caf@L$CaN-`PnYdtXeg
zTK4JZ+aUX0IO+zkZ-t{><B9_NZrY_OaHrrfEW*n?*sifNA8sn#18|J#y9hK7-wewm
z_?y;YPiCN)FXhu^W5>k-GpplLPv3jvqUXO5*~&oAoYenIkb3)ij(YizKKqqtudTUx
z($$BM|JI*>g8BbjIOdi4XTE2`?S~r=$AJygehQBHJqtGjt^mh!V0o}y9))wt!Ak!G
z9UkJE-}3;bUzWY~WV-jW!~5B(Ccq=%EL0}yNWOTk#7EgnI()FaA{a07T{8u&2b|X9
zc7z$j!98mJRxz5OEWhGtJdV=OSmPfhcGTW}ljD!T>NjBM!8`>2cjr=+fY%Q9rPG-K
v(`t@J2cD%fT-DM&MsFsaUaxn)>K403Yw4Qx>Sr4sf6J(g@=cF#a0&bug$!N^

diff --git a/framework/pmd_output.py b/framework/pmd_output.py
index e8e2a2c..f52332b 100644
--- a/framework/pmd_output.py
+++ b/framework/pmd_output.py
@@ -119,6 +119,10 @@ class PmdOutput():
         self.coremask = create_mask(core_list)
         command = "./%s/app/testpmd -c %s -n %d %s -- -i %s" \
             % (self.dut.target, self.coremask, self.dut.get_memory_channels(), eal_param, param)
+        if "cavium" in self.dut.nic_type:
+            # thunder nicvf does not support hw vlan filter, the application crashes
+            # without this option added
+            command += " --disable-hw-vlan-filter"
         out = self.dut.send_expect(command, "testpmd> ", 120)
         self.command = command
         return out
diff --git a/tests/TestSuite_pmdpcap.py b/tests/TestSuite_pmdpcap.py
index a080dd0..0a79e96 100644
--- a/tests/TestSuite_pmdpcap.py
+++ b/tests/TestSuite_pmdpcap.py
@@ -124,6 +124,8 @@ class TestPmdPcap(TestCase):
         command = ("./{}/app/testpmd -c {} -n {} " +
                    "--vdev=eth_pcap0,rx_pcap={},tx_pcap={} " +
                    "-- -i --port-topology=chained")
+        if "cavium" in self.dut.nic_type:
+            command += " --disable-hw-vlan-filter"
 
         self.dut.send_expect(command.format(self.target, core_mask,
                              self.memory_channel,
@@ -158,6 +160,8 @@ class TestPmdPcap(TestCase):
                    "--vdev=eth_pcap0,rx_pcap={},tx_pcap={} " +
                    "--vdev=eth_pcap1,rx_pcap={},tx_pcap={} " +
                    "-- -i")
+        if "cavium" in self.dut.nic_type:
+            command += " --disable-hw-vlan-filter"
 
         self.dut.send_expect(command.format(self.target, core_mask,
                                             self.memory_channel,
diff --git a/tests/TestSuite_short_live.py b/tests/TestSuite_short_live.py
index 320951f..72745a9 100644
--- a/tests/TestSuite_short_live.py
+++ b/tests/TestSuite_short_live.py
@@ -125,7 +125,7 @@ class TestShortLiveApp(TestCase):
         Basic rx/tx forwarding test
         """
         #dpdk start
-        self.dut.send_expect("./x86_64-native-linuxapp-gcc/app/testpmd -c 0xf -n 4 -- -i --portmask=0x3", "testpmd>", 120)
+        self.dut.send_expect("./%s/app/testpmd -c 0xf -n 4 -- -i --portmask=0x3" % self.target, "testpmd>", 120)
         self.dut.send_expect("set fwd mac", "testpmd>")
         self.dut.send_expect("set promisc all off", "testpmd>")
         self.dut.send_expect("start", "testpmd>")
@@ -137,7 +137,7 @@ class TestShortLiveApp(TestCase):
         """
         time = []
         regex = re.compile(".* (\d+:\d{2}\.\d{2}).*")
-        out = self.dut.send_expect("echo quit | time ./x86_64-native-linuxapp-gcc/app/testpmd -c 0x3 -n 4 --no-pci -- -i", "#", 120)
+        out = self.dut.send_expect("echo quit | time ./%s/app/testpmd -c 0x3 -n 4 --no-pci -- -i" % self.target, "#", 120)
         time = regex.findall(out)
 
         if time != []:
@@ -150,7 +150,7 @@ class TestShortLiveApp(TestCase):
         for i in range(repeat_time):
             #dpdk start
             print "clean_up_with_signal_testpmd round %d" % (i + 1)
-            self.dut.send_expect("./x86_64-native-linuxapp-gcc/app/testpmd -c 0xf -n 4 -- -i --portmask=0x3", "testpmd>", 120)
+            self.dut.send_expect("./%s/app/testpmd -c 0xf -n 4 -- -i --portmask=0x3" % self.target, "testpmd>", 120)
             self.dut.send_expect("set fwd mac", "testpmd>")
             self.dut.send_expect("set promisc all off", "testpmd>")
             self.dut.send_expect("start", "testpmd>")
diff --git a/tests/TestSuite_shutdown_api.py b/tests/TestSuite_shutdown_api.py
index 66219f5..b616ed5 100644
--- a/tests/TestSuite_shutdown_api.py
+++ b/tests/TestSuite_shutdown_api.py
@@ -332,25 +332,26 @@ class TestShutdownApi(TestCase):
         jumbo_size = 2048
         self.pmdout.start_testpmd("Default", "--portmask=%s --port-topology=loop" % utils.create_mask(self.ports), socket=self.ports_socket)
         self.dut.send_expect("port stop all", "testpmd> ", 100)
-        self.dut.send_expect("vlan set strip off all", "testpmd> ")
-        self.dut.send_expect("port config all max-pkt-len %d" % jumbo_size, "testpmd> ")
-        for port in self.ports:
-            self.dut.send_expect("rx_vlan add 1 %d" % port, "testpmd> ")
-        self.dut.send_expect("set fwd mac", "testpmd>")
-        self.dut.send_expect("port start all", "testpmd> ", 100)
-        self.dut.send_expect("start", "testpmd> ")
+        out = self.dut.send_expect("vlan set strip off all", "testpmd> ")
+        if "fail" not in out:
+            self.dut.send_expect("port config all max-pkt-len %d" % jumbo_size, "testpmd> ")
+            for port in self.ports:
+                self.dut.send_expect("rx_vlan add 1 %d" % port, "testpmd> ")
+            self.dut.send_expect("set fwd mac", "testpmd>")
+            self.dut.send_expect("port start all", "testpmd> ", 100)
+            self.dut.send_expect("start", "testpmd> ")
 
-        if self.nic in ['magnolia_park', 'niantic', 'twinpond', 'kawela_4', 'ironpond', 'springfountain', 'springville', 'powerville']:
-            # nantic vlan length will not be calculated
-            vlan_jumbo_size = jumbo_size + 4
-        else:
-            vlan_jumbo_size = jumbo_size
+            if self.nic in ['magnolia_park', 'niantic', 'twinpond', 'kawela_4', 'ironpond', 'springfountain', 'springville', 'powerville']:
+                # nantic vlan length will not be calculated
+                vlan_jumbo_size = jumbo_size + 4
+            else:
+                vlan_jumbo_size = jumbo_size
 
-        self.check_forwarding(pktSize=vlan_jumbo_size - 1, vlan=True)
-        self.check_forwarding(pktSize=vlan_jumbo_size, vlan=True)
-        self.check_forwarding(pktSize=vlan_jumbo_size + 1, received=False, vlan=True)
+            self.check_forwarding(pktSize=vlan_jumbo_size - 1, vlan=True)
+            self.check_forwarding(pktSize=vlan_jumbo_size, vlan=True)
+            self.check_forwarding(pktSize=vlan_jumbo_size + 1, received=False, vlan=True)
 
-        self.dut.send_expect("stop", "testpmd> ")
+            self.dut.send_expect("stop", "testpmd> ")
 
         self.dut.send_expect("port stop all", "testpmd> ", 100)
         self.dut.send_expect("port config all hw-vlan off", "testpmd> ")
-- 
2.7.4