Comments (7)
from networkml.
@jseparovic that's a bug with running it in python3.6. Updating to python3.7 will fix this issue. However, it's something we should handle, so I'll keep this open and work on a quick patch. Will update here when it's ready.
from networkml.
@jseparovic PR #560 addresses this (thanks @anarkiwi !) I’ll merge it in when the tests finish. Feel free to reopen this if the problem persists with these changes.
from networkml.
@cglewis thanks for the fast response. Just on the data pre-processing for training, is there a specific utility from the Poseidon code base I can look at to understand how to transform a full pcap file into the processed pcap file required for training?
from networkml.
@cglewis Just noticed the Makefile dev target is pointing to 3.6, should this be 3.7 ?
https://github.com/CyberReboot/NetworkML/blob/master/Makefile#L93
from networkml.
For cutting up a pcap for training that captured from more than one host, the easiest way is it to use something like `tshark -r input.pcap -w output.pcap -Y "eth.addr == " (replacing with the MAC address of the device in your PCAP you want to train with.
Then name the output.pcap file to something like: DevWorkstation-uniquename-Wed2350-n00.pcap
where DevWorkstation is the label (https://github.com/CyberReboot/NetworkML/blob/master/networkml/configs/label_assignments.json) of that device you want to train and the rest of the parts of the filename don't really matter, but let you keep track of different devices with the same role, date/time, and option to dedup overlap.
As for the Makefile, yes, you're right - would you be open to making a PR for that? Thanks.
from networkml.
@cglewis needed to also update posml-dev.yml as conda was taking the versions from there even after setting env create python=3.7
Here's a PR for the change #562
(posml-dev) [root@d2 NetworkML]# python -V
Python 3.7.6
(posml-dev) [root@d2 NetworkML]# pip -V
pip 20.0.2 from /root/anaconda3/envs/posml-dev/lib/python3.7/site-packages/pip (python 3.7)
from networkml.
Related Issues (20)
- make Redis optional
- warnings and deprecations need to be cleaned up HOT 2
- re-format rabbit message
- some pcaps will throw a traceback HOT 4
- `make help` throws an EOF
- Tensorflow2 Code Not Idiomatic HOT 1
- Zero features found from small PCAPs error HOT 1
- bad len packets throw traceback in reader.py HOT 3
- networkml uses TCP/IP or UDP/IP only HOT 1
- Import deprecation warnings
- Version mismatch for pickled files
- IPv6 is broken due to the index of fields being hardcoded HOT 2
- Runtime warnings HOT 1
- source_mac cuts off the first value
- Is threshold_time missing from Model creation? HOT 2
- Add flag to choose canonical source MAC
- Action Required: Fix Renovate Configuration HOT 1
- pandas 1.3.0 sometimes fails to calculate quantile 0.75
- Dependency Dashboard
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from networkml.