OpenSM: Add information about limitations

[clameter]

Please add some information on the limitations of OpenSM. From what I know these are

1. No SR-IOV support
2. Multicast sweeps may cause multicast micro-loops which can cause the SM to fail.
3. No Multicast support for ConnectX5 and 6.

These are issues fixed in the Mellanox OFED OpenSM.

[dcontiveros]

I was attempting to setup SRIOV with Connect-X 4 card and ran into an issue where the physical link is up, but the state reports as down. From what I have read online, virtualization needs to be enabled, but I cannot see where to do that in this version of OpenSM.

I am attempting to avoid all Nvidia drivers. I see there is this documentation:

https://github.com/linux-rdma/opensm/blob/master/doc/opensm-sriov.txt

However, I cannot seem to find a working example of how to use these two configuration options to get SRIOV working.

I have virtual functions in lspci, am able to unbind/bind to vfio. I am now just lacking the OpenSM functionality.

[vladko1974]

Hi, SRIOV with ConnectX4+ devices is supported only with NVIDIA SM that can be downloaded from NVIDIA Web. https://network.nvidia.com/products/adapter-software/infiniband-management-and-monitoring-tools/ Regards, Vladimir From: David Ontiveros ***@***.***> Sent: Monday, 4 September 2023 0:34 To: linux-rdma/opensm ***@***.***> Cc: Subscribed ***@***.***> Subject: Re: [linux-rdma/opensm] OpenSM: Add information about limitations (#22) I was attempting to setup SRIOV with Connect-X 4 card and ran into an issue where the physical link is up, but the state reports as down. From what I have read online, virtualization needs to be enabled, but I cannot see where to do that in this version of OpenSM. I am attempting to avoid all Nvidia drivers. I see there is this documentation: https://github.com/linux-rdma/opensm/blob/master/doc/opensm-sriov.txt However, I cannot seem to find a working example of how to use these two configuration options to get SRIOV working. I have virtual functions in lspci, am able to unbind/bind to vfio. I am now just lacking the OpenSM functionality. — Reply to this email directly, view it on GitHub<#22 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AD6PRHGHO2CVUKDT5KGXNPDXYTZV7ANCNFSM4THTI5JA>. You are receiving this because you are subscribed to this thread.Message ID: ***@***.******@***.***>>

[dcontiveros]

Thanks Vladimir. Would it be possible to add SRIOV support as a feature request ? Is it even possible?

[vladko1974]

We are recommending to use NVDIA SM rpm from Web for customers that can’t use NVIDIA SM from MOFED. From: David Ontiveros ***@***.***> Sent: Monday, 4 September 2023 15:08 To: linux-rdma/opensm ***@***.***> Cc: Vladimir Koushnir ***@***.***>; Comment ***@***.***> Subject: Re: [linux-rdma/opensm] OpenSM: Add information about limitations (#22) Thanks Vladimir. Would it be possible to add SRIOV support as a feature request ? Is it even possible? — Reply to this email directly, view it on GitHub<#22 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AD6PRHCE3UQRHITDP633FXDXYXAB3ANCNFSM4THTI5JA>. You are receiving this because you commented.Message ID: ***@***.******@***.***>>