tsc@lists.fd.io | Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Home Messages Hashtags Subgroups

Date Date 1 - 12 of 12

Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Maciek Konstantynowicz (mkonstan)

#1128

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Show quoted text

Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)

#1129

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

are used by TRex [5], VPP [6] and CSIT python code
([7] indirectly via TRex for performance tests,
[8] directly for functional tests).
Additionally, VPP even patches [9] the scapy code,
so it uses a modified code.

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

and original VPP python parts linked together,
which is not allowed by GLP2 (as far as I understand).

Similarly, CSIT jobs are running performance and functional tests
with python parts linking together incompatible [10] licenses.

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[5] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_packet_builder_scapy.py#L13
[6] https://github.com/FDio/vpp/blob/master/test/test_ip4.py#L7-L11

[7] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/profile_trex_stateless_base_class.py#L24
[8] https://github.com/FDio/csit/blob/master/resources/libraries/python/PacketVerifier.py#L70-L73

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Show quoted text

From: Maciek Konstantynowicz (mkonstan) <mkonstan@...>
Sent: Thursday, October 10, 2019 5:47 PM
To: tsc@...; Ed Warnicke (eaw) <eaw@...>; Kinsella, Ray <ray.kinsella@...>
Cc: Miroslav Los -X (mirlos - PANTHEON TECHNOLOGIES at Cisco) <mirlos@...>; Hanoch Haim (hhaim) <hhaim@...>; Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) <vrpolak@...>
Subject: Re: Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Ray Kinsella

#1130

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

1. How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

2. How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Show quoted text

From: tsc@... [mailto:tsc@...] On Behalf Of Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) via Lists.Fd.Io
Sent: Thursday 10 October 2019 17:24
To: Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>; Kinsella, Ray <ray.kinsella@...>
Cc: tsc@...
Subject: Re: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)

#1131

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

I am not entirely sure how vpp "make test" sends packets to VPP.

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.
In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Show quoted text

From: Kinsella, Ray <ray.kinsella@...>
Sent: Friday, October 11, 2019 10:58 AM
To: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) <vrpolak@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: RE: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Ray Kinsella

#1132

Hi Vratko,

Inline.

Show quoted text

From: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) [mailto:vrpolak@...]
Sent: Friday 11 October 2019 17:20
To: Kinsella, Ray <ray.kinsella@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: RE: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)

#1133

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Show quoted text

From: tsc@... <tsc@...> On Behalf Of Ray Kinsella
Sent: Monday, October 14, 2019 10:57 AM
To: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) <vrpolak@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: Re: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Ray Kinsella

#1134

Ok … we need to contain the problem domain here, as it is way too complicated at the moment.

Why is TRex’s licensing being questioned?

Aren’t we just consumers or TRex, we don’t redistribute do we (is it still a FD.io project).

If we don’t redistribute, can’t we just take it’s licensing at face value?

Show quoted text

From: tsc@... [mailto:tsc@...] On Behalf Of Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) via Lists.Fd.Io
Sent: Monday 14 October 2019 14:20
To: Kinsella, Ray <ray.kinsella@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Cc: tsc@...
Subject: Re: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

[rk] Ok – this appears to be safe then.

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)

#1135

> Why is TRex’s licensing being questioned?

It just happened to be the first FD.io project

examined (by Miroslav) for dependencies.

VPP and CSIT were examined (by Vratko) few days later.

> If we don’t redistribute, can’t we just take it’s licensing at face value?

We (CSIT) could do that, except that CSIT also uses scapy directly.

We (FD.io) cannot do that, as TRex is a FD.io project

which distributes TRex code, including the problematic Python bits.

I believe even having the git repository publicly cloneable

counts as distributing the software.

Vratko.

Show quoted text

From: Kinsella, Ray <ray.kinsella@...>
Sent: Tuesday, October 15, 2019 1:05 PM
To: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) <vrpolak@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: RE: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

Ok … we need to contain the problem domain here, as it is way too complicated at the moment.

Why is TRex’s licensing being questioned?

Aren’t we just consumers or TRex, we don’t redistribute do we (is it still a FD.io project).

If we don’t redistribute, can’t we just take it’s licensing at face value?

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

[rk] Ok – this appears to be safe then.

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Ray Kinsella

#1136

Show quoted text

From: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) [mailto:vrpolak@...]
Sent: Wednesday 16 October 2019 12:10
To: Kinsella, Ray <ray.kinsella@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: RE: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

> Why is TRex’s licensing being questioned?

It just happened to be the first FD.io project

examined (by Miroslav) for dependencies.

VPP and CSIT were examined (by Vratko) few days later.

[rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

I am not 100% certain it is still a FD.io project?

> If we don’t redistribute, can’t we just take it’s licensing at face value?

We (CSIT) could do that, except that CSIT also uses scapy directly.

[rk] Ok, can we focus and resolve on CSIT’s usage first

[rk] Can we be clear that anything in CSIT that links/loads scapy directly is GPL’ed (or a compatible license).

[rk] Anything else (non-GPL’ed) that talk’s to scapy via interfaces that preserve isolation?

We (FD.io) cannot do that, as TRex is a FD.io project

which distributes TRex code, including the problematic Python bits.

[rk] Ok – we need Ed to check this.

[rk] In that case, should it not be someone from TRex covering it?

I believe even having the git repository publicly cloneable

counts as distributing the software.

[rk] Perhaps, but there has been no contributions to the FD.io VPP TRex git since 2017

[rk] We need to ask, what the best approach is here.

Vratko.

Ok … we need to contain the problem domain here, as it is way too complicated at the moment.

Why is TRex’s licensing being questioned?

Aren’t we just consumers or TRex, we don’t redistribute do we (is it still a FD.io project).

If we don’t redistribute, can’t we just take it’s licensing at face value?

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

[rk] Ok – this appears to be safe then.

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)

#1137

> [rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

> I am not 100% certain it is still a FD.io project?

TRex is still FD.io project as far as I know.

Git+Gerrit server at gerrit.fd.io is just a tool,

projects are not required to use it.

The github repo is the official primary one for TRex,

while CSIT and VPP still use gerrit.fd.io as the primary,

and github just as a mirror.

> counts as distributing the software.

TRex offers releases for download, for example [19].

They are basically archives of git content at that time,

including the problematic Python bits.

> Can we be clear that anything in CSIT that links/loads

> scapy directly is GPL’ed (or a compatible license).

Looking at the Charter [18], we can do that according to 7.c,

(giving us the exception to otherwise prohibiting 7.b.i and 7.b.iii).

The downside is, around 90% or more of CSIT code would end up as GPL

(almost everything is linked together).

Reducing the percentage by offloading the scapy processing

into a separate process is of course possible,

but it would also require a considerable effort to finish.

Anyway, switching parts of code to GPL quickly

and then reducing the amount of code affected slowly

looks like a good plan to me.

7.c just requires a request, justification, and two-thirds TSC vote.

Vratko.

[18] https://fd.io/docs/tsc/FD.IO-Project-a-Series-of-LF-Projects-LLC-Technical-Charter-12-13-2017-FINAL.pdf

[19] https://github.com/cisco-system-traffic-generator/trex-core/releases/tag/v2.61

Show quoted text

From: tsc@... <tsc@...> On Behalf Of Ray Kinsella
Sent: Wednesday, October 16, 2019 1:32 PM
To: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) <vrpolak@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: Re: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

> Why is TRex’s licensing being questioned?

It just happened to be the first FD.io project

examined (by Miroslav) for dependencies.

VPP and CSIT were examined (by Vratko) few days later.

[rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

I am not 100% certain it is still a FD.io project?

> If we don’t redistribute, can’t we just take it’s licensing at face value?

We (CSIT) could do that, except that CSIT also uses scapy directly.

[rk] Ok, can we focus and resolve on CSIT’s usage first

[rk] Can we be clear that anything in CSIT that links/loads scapy directly is GPL’ed (or a compatible license).

[rk] Anything else (non-GPL’ed) that talk’s to scapy via interfaces that preserve isolation?

We (FD.io) cannot do that, as TRex is a FD.io project

which distributes TRex code, including the problematic Python bits.

[rk] Ok – we need Ed to check this.

[rk] In that case, should it not be someone from TRex covering it?

I believe even having the git repository publicly cloneable

counts as distributing the software.

[rk] Perhaps, but there has been no contributions to the FD.io VPP TRex git since 2017

[rk] We need to ask, what the best approach is here.

Vratko.

Ok … we need to contain the problem domain here, as it is way too complicated at the moment.

Why is TRex’s licensing being questioned?

Aren’t we just consumers or TRex, we don’t redistribute do we (is it still a FD.io project).

If we don’t redistribute, can’t we just take it’s licensing at face value?

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

[rk] Ok – this appears to be safe then.

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Joel Halpern

#1138

I have a real problem with important parts of fd.io (and CSIT is an important part both for the project and for consumers of the project) being tied to GPL.

I am really unhappy that we are only discovering this now.

Yours,

Joel

Show quoted text

From: tsc@... <tsc@...> On Behalf Of Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) via Lists.Fd.Io
Sent: Wednesday, October 16, 2019 10:26 AM
To: Ray Kinsella <ray.kinsella@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Cc: tsc@...
Subject: Re: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

> [rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

> I am not 100% certain it is still a FD.io project?

TRex is still FD.io project as far as I know.

Git+Gerrit server at gerrit.fd.io is just a tool,

projects are not required to use it.

The github repo is the official primary one for TRex,

while CSIT and VPP still use gerrit.fd.io as the primary,

and github just as a mirror.

> counts as distributing the software.

TRex offers releases for download, for example [19].

They are basically archives of git content at that time,

including the problematic Python bits.

> Can we be clear that anything in CSIT that links/loads

> scapy directly is GPL’ed (or a compatible license).

Looking at the Charter [18], we can do that according to 7.c,

(giving us the exception to otherwise prohibiting 7.b.i and 7.b.iii).

The downside is, around 90% or more of CSIT code would end up as GPL

(almost everything is linked together).

Reducing the percentage by offloading the scapy processing

into a separate process is of course possible,

but it would also require a considerable effort to finish.

Anyway, switching parts of code to GPL quickly

and then reducing the amount of code affected slowly

looks like a good plan to me.

7.c just requires a request, justification, and two-thirds TSC vote.

Vratko.

[18] https://fd.io/docs/tsc/FD.IO-Project-a-Series-of-LF-Projects-LLC-Technical-Charter-12-13-2017-FINAL.pdf

[19] https://github.com/cisco-system-traffic-generator/trex-core/releases/tag/v2.61

> Why is TRex’s licensing being questioned?

It just happened to be the first FD.io project

examined (by Miroslav) for dependencies.

VPP and CSIT were examined (by Vratko) few days later.

[rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

I am not 100% certain it is still a FD.io project?

> If we don’t redistribute, can’t we just take it’s licensing at face value?

We (CSIT) could do that, except that CSIT also uses scapy directly.

[rk] Ok, can we focus and resolve on CSIT’s usage first

[rk] Can we be clear that anything in CSIT that links/loads scapy directly is GPL’ed (or a compatible license).

[rk] Anything else (non-GPL’ed) that talk’s to scapy via interfaces that preserve isolation?

We (FD.io) cannot do that, as TRex is a FD.io project

which distributes TRex code, including the problematic Python bits.

[rk] Ok – we need Ed to check this.

[rk] In that case, should it not be someone from TRex covering it?

I believe even having the git repository publicly cloneable

counts as distributing the software.

[rk] Perhaps, but there has been no contributions to the FD.io VPP TRex git since 2017

[rk] We need to ask, what the best approach is here.

Vratko.

Ok … we need to contain the problem domain here, as it is way too complicated at the moment.

Why is TRex’s licensing being questioned?

Aren’t we just consumers or TRex, we don’t redistribute do we (is it still a FD.io project).

If we don’t redistribute, can’t we just take it’s licensing at face value?

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

[rk] Ok – this appears to be safe then.

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco)

#1141

> only discovering this now.

Not sure if it is relevant, but scapy linking has been introduced

to TRex [20], CSIT [21] and VPP [22] in 2016

(although for CSIT it was the first real commit in the open-source repo,

so closed-source linking probably happened sooner),

in what seems to me like three independent decisions.

Vratko.

[20] https://github.com/cisco-system-traffic-generator/trex-core/commit/f7d24e3fde8dbd36f9e2679307f5f384022857f2

[21] https://gerrit.fd.io/r/c/csit/+/107

[22] https://gerrit.fd.io/r/c/vpp/+/3237

Show quoted text

From: Joel Halpern <joel.halpern@...>
Sent: Wednesday, October 16, 2019 4:30 PM
To: Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) <vrpolak@...>; Ray Kinsella <ray.kinsella@...>; Maciek Konstantynowicz (mkonstan) <mkonstan@...>; tsc@...; Ed Warnicke (eaw) <eaw@...>
Subject: RE: [tsc] Scapy licensing issue in FD.io projects [Was: TRex distribution and licensing of external libraries]

I have a real problem with important parts of fd.io (and CSIT is an important part both for the project and for consumers of the project) being tied to GPL.

I am really unhappy that we are only discovering this now.

Yours,

Joel

> [rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

> I am not 100% certain it is still a FD.io project?

TRex is still FD.io project as far as I know.

Git+Gerrit server at gerrit.fd.io is just a tool,

projects are not required to use it.

The github repo is the official primary one for TRex,

while CSIT and VPP still use gerrit.fd.io as the primary,

and github just as a mirror.

> counts as distributing the software.

TRex offers releases for download, for example [19].

They are basically archives of git content at that time,

including the problematic Python bits.

> Can we be clear that anything in CSIT that links/loads

> scapy directly is GPL’ed (or a compatible license).

Looking at the Charter [18], we can do that according to 7.c,

(giving us the exception to otherwise prohibiting 7.b.i and 7.b.iii).

The downside is, around 90% or more of CSIT code would end up as GPL

(almost everything is linked together).

Reducing the percentage by offloading the scapy processing

into a separate process is of course possible,

but it would also require a considerable effort to finish.

Anyway, switching parts of code to GPL quickly

and then reducing the amount of code affected slowly

looks like a good plan to me.

7.c just requires a request, justification, and two-thirds TSC vote.

Vratko.

[18] https://fd.io/docs/tsc/FD.IO-Project-a-Series-of-LF-Projects-LLC-Technical-Charter-12-13-2017-FINAL.pdf

[19] https://github.com/cisco-system-traffic-generator/trex-core/releases/tag/v2.61

> Why is TRex’s licensing being questioned?

It just happened to be the first FD.io project

examined (by Miroslav) for dependencies.

VPP and CSIT were examined (by Vratko) few days later.

[rk] Ok my understand is that TRex had moved to github – that TRex repo is dead.

I am not 100% certain it is still a FD.io project?

> If we don’t redistribute, can’t we just take it’s licensing at face value?

We (CSIT) could do that, except that CSIT also uses scapy directly.

[rk] Ok, can we focus and resolve on CSIT’s usage first

[rk] Can we be clear that anything in CSIT that links/loads scapy directly is GPL’ed (or a compatible license).

[rk] Anything else (non-GPL’ed) that talk’s to scapy via interfaces that preserve isolation?

We (FD.io) cannot do that, as TRex is a FD.io project

which distributes TRex code, including the problematic Python bits.

[rk] Ok – we need Ed to check this.

[rk] In that case, should it not be someone from TRex covering it?

I believe even having the git repository publicly cloneable

counts as distributing the software.

[rk] Perhaps, but there has been no contributions to the FD.io VPP TRex git since 2017

[rk] We need to ask, what the best approach is here.

Vratko.

Ok … we need to contain the problem domain here, as it is way too complicated at the moment.

Why is TRex’s licensing being questioned?

Aren’t we just consumers or TRex, we don’t redistribute do we (is it still a FD.io project).

If we don’t redistribute, can’t we just take it’s licensing at face value?

>> I am not entirely sure how vpp "make test" sends packets to VPP.

> [rk] I thought it was veth network interface or similar, can you check?

It seems this document [11] still applies.

The python test code uses the linked scapy to define packet objects,

turns those (by calling a scapy function) into a pcap file,

and notifies a (separate) VPP process to read the file.

Receiving is the inverse. VPP creates pcap files,

and python test code parses that (once again using linked scapy).

[rk] Ok – this appears to be safe then.

>> Scapy does not send packets to TRex, scapy objects are only used

>> as a "template" for TRex to create packets (in C) from.

> [rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

A specific "template" is defined in CSIT repository

(as a set of .py files, for example [14], already using scapy classes).

During test setup, the files are copied to the

machine that has TRex installed.

When test starts, another CSIT python utility

(not directly linked with scapy) is started on the TRex machine,

it imports and calls [13] the python part of TRex installation,

which dynamically imports [12] the template in question.

In the previous e-mail I mentioned this [5] file,

part of TRex python code, which further processes the template,

occasionally using direct calls to scapy functions.

I am not sure how the information processing

continues towards the C engine of TRex,

but the description so far should be enough

to show the license issues of the current usage.

TRex also accepts different formats (json, yaml and pcap)

for the "templates". Not sure whether their processing

also relies on scapy, but CSIT does not use those formats.

> We need an IP diagram with the modules/processes involved,

> how there are linked and their licensing.

Usually, there is only one process with licensing issues

(running Python interpreter), but with way too many modules

for me to track.

Or did you mean python packages (instead of modules)?

Direct dependencies are [15] for main CSIT and [16] for VPP test.

I am not sure what the dependencies are for TRex,

but [17] seems to be a good list.

Vratko.

[11] https://github.com/FDio/vpp/blob/master/test/doc/overview.rst#packet-flow-in-the-vtf

[12] https://github.com/cisco-system-traffic-generator/trex-core/blob/v2.61/scripts/automation/trex_control_plane/interactive/trex/stl/trex_stl_streams.py#L1029

[13] https://github.com/FDio/csit/blob/master/resources/tools/trex/trex_stateless_profile.py#L111-L112

[14] https://github.com/FDio/csit/blob/master/resources/traffic_profiles/trex/trex-sl-2n-dot1qip4asym-ip4src254.py

[15] https://github.com/FDio/csit/blob/master/requirements.txt

[16] https://github.com/FDio/vpp/blob/master/test/requirements.txt

[17] https://github.com/cisco-system-traffic-generator/trex-core/tree/v2.61/scripts/external_libs

Hi Vratko,

Inline.

> How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?

The setup details differ. The C projects (VPP and the main part of TRex server)

are usually separate processes, being accessed by official interfaces.

But each setup contains (at least) one process

which is running Python interpreter running mixed code.

[rk] Ok, the principle of separation is important here.

[rk] As anything that ‘links’ directly with Scapy is affected.

[rk] You _can_ still talk to Scapy via an interface that achieves separation; stdin/stdout, network, socket etc.

By mixed code I mean the upper layers are coming from FD.io repositories

(thus Apache license 2.0 applies), but the virtualenv contains scapy installation.

[rk] Containing a Scapy installation does not automatically effect anything else.

[rk] You are, however obliged to ensure the source code of the version of scapy you used was ‘available on request’.

The upper layers are importing scapy modules and classes,

instantiating scapy objects and calling scapy methods.

This would be permitted if scapy was LGPL, but not for GPL.

[rk] Agreed anything that ‘link’s with Scapy in this way, would have to be GPL’ed I imagine.

[rk] For TRex/VPP

[rk] We need an IP diagram with the modules/processes involved, how there are linked and their licensing.

[rk] It doesn’t need to be exhaustive, but it needs to show the main actors.

[rk] Ed – is there a LF process to resolve these kinds of issues?

> How is the data (packets) scapy creates consumed by VPP/TRex,
> through an API or a Unix Socket or a Network Interface?

For CSIT usage, VPP consumes packets only via network interface.

[rk] This is safe, I would think.

I am not entirely sure how vpp "make test" sends packets to VPP.

[rk] I thought it was veth network interface or similar, can you check?

Scapy does not send packets to TRex, scapy objects are only used

as a "template" for TRex to create packets (in C) from.

[rk] Ok – but we need detail here, how does TRex – ‘get’ the template?

In VPP and CSIT tests, scapy is mainly used

to parse packets received (via an official interface) from VPP.

[rk] Understood

> how TRex & VPP “talk” to scapy

Simplified from the above:

TRex and VPP (almost) do not talk to scapy on their own.

But most verify jobs are running fd.io python programs

which depend on scapy as a library.

Vratko.

Hi Vratko,

So there is a lot of information thanks for putting this together.

What is of primary importance to understand is how TRex & VPP “talk” to scapy.

Scapy is GPL, any modifications made to Scapy are therefore clearly covered by the GPL.

Some questions

How is scapy invoked, is it a separate process or is it directly like with VPP/TRex?
How is the data (packets) scapy creates consumed by VPP/TRex,
through an API or a Unix Socket or a Network Interface?

Thanks,

Ray K

Adding some technical details with quick links.

Scapy license [0] is GLP, not LGPL.

In python, using "import" statement amounts to linking,

which creates [1] a combined program, instead of

a mere aggregation of different programs.

FD.io projects apply Apache 2.0 license,
globally to the whole repository in case of

TRex [2], VPP [3] and CSIT [4].

The scapy code is imported, and the internal data structures

The product of VPP is packaged mostly as binary

(source code is in C), and the packaged Python code

is not related to scapy as far as I know.

But VPP verify jobs are executing tests,

which run the code containing (modified) scapy parts

Vratko.

[0] https://github.com/secdev/scapy/blob/master/LICENSE

[1] https://www.gnu.org/licenses/gpl-faq.en.html#MereAggregation

[2] https://github.com/cisco-system-traffic-generator/trex-core/blob/master/LICENSE

[3] https://github.com/FDio/vpp/blob/master/LICENSE

[4] https://github.com/FDio/csit/blob/master/LICENSE

[9] https://github.com/FDio/vpp/blob/master/test/Makefile#L120-L122

[10] https://www.apache.org/licenses/GPL-compatibility.html

Resending from Cisco email account as it’s back and cleared for sending emails to tsc mailer.

Adding Miroslav, Hanoh and Vratko who has been also involved here (Miroslav brought up the issue).

Ed, Ray,

Per our discussion on FD.io TSC call few mins ago, pls advise on the next steps.

Specifically, how to articulate this case in a crisp and succinct manner for LF(N) legal advisor?

Cheers,

-Maciek

1 - 12 of 12

Previous Topic Next Topic

Home Hashtags Subgroups Terms