9.8. PCI vNTB Function

Author:Frank Li <Frank.Li@nxp.com>

The difference between PCI NTB function and PCI vNTB function is

PCI NTB function need at two endpoint instances and connect HOST1 and HOST2.

PCI vNTB function only use one host and one endpoint(EP), use NTB connect EP and PCI host

+------------+         +---------------------------------------+
|            |         |                                       |
+------------+         |                        +--------------+
| NTB        |         |                        | NTB          |
| NetDev     |         |                        | NetDev       |
+------------+         |                        +--------------+
| NTB        |         |                        | NTB          |
| Transfer   |         |                        | Transfer     |
+------------+         |                        +--------------+
|            |         |                        |              |
|  PCI NTB   |         |                        |              |
|    EPF     |         |                        |              |
|   Driver   |         |                        | PCI Virtual  |
|            |         +---------------+        | NTB Driver   |
|            |         | PCI EP NTB    |<------>|              |
|            |         |  FN Driver    |        |              |
+------------+         +---------------+        +--------------+
|            |         |               |        |              |
|  PCI BUS   | <-----> |  PCI EP BUS   |        |  Virtual PCI |
|            |  PCI    |               |        |     BUS      |
+------------+         +---------------+--------+--------------+
    PCI RC                        PCI EP

9.8.1. Constructs used for Implementing vNTB

  1. Config Region
  2. Self Scratchpad Registers
  3. Peer Scratchpad Registers
  4. Doorbell (DB) Registers
  5. Memory Window (MW)

9.8.1.1. Config Region:

It is same as PCI NTB Function driver

9.8.1.2. Scratchpad Registers:

It is appended after Config region.

+--------------------------------------------------+ Base
|                                                  |
|                                                  |
|                                                  |
|          Common Config Register                  |
|                                                  |
|                                                  |
|                                                  |
+-----------------------+--------------------------+ Base + span_offset
|                       |                          |
|    Peer Span Space    |    Span Space            |
|                       |                          |
|                       |                          |
+-----------------------+--------------------------+ Base + span_offset
|                       |                          |      + span_count * 4
|                       |                          |
|     Span Space        |   Peer Span Space        |
|                       |                          |
+-----------------------+--------------------------+
      Virtual PCI             Pcie Endpoint
      NTB Driver               NTB Driver

9.8.1.3. Doorbell Registers:

Doorbell Registers are used by the hosts to interrupt each other.

9.8.1.4. Memory Window:

Actual transfer of data between the two hosts will happen using the memory window.

9.8.2. Modeling Constructs:

32-bit BARs.

BAR NO CONSTRUCTS USED
BAR0 Config Region
BAR1 Doorbell
BAR2 Memory Window 1
BAR3 Memory Window 2
BAR4 Memory Window 3
BAR5 Memory Window 4

64-bit BARs.

BAR NO CONSTRUCTS USED
BAR0 Config Region + Scratchpad
BAR1  
BAR2 Doorbell
BAR3  
BAR4 Memory Window 1
BAR5