Giter Club home page Giter Club logo

network-tools's People

Contributors

anarkiwi avatar bpagon13 avatar cglewis avatar chakrihacker avatar codeavenger07 avatar d-grossman avatar davedittrich avatar dependabot[bot] avatar jacobjangles avatar jbenjoseph avatar jeff-wang93 avatar kylelilly avatar luiscoms avatar pbronez avatar pyup-bot avatar rashley-iqt avatar renovate-bot avatar renovate[bot] avatar schvin avatar slugo avatar sootysec avatar tsheaiqt avatar yknot avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

network-tools's Issues

p0f should optionally provide additional info about servers

specifically link type and server os

p0f: [2018/05/10 20:27:25] mod=mtu|cli=10.98.248.43/50713|srv=108.177.98.95/443|subj=srv|link=generic tunnel or VPN|raw_mtu=1420
p0f: [2018/05/10 20:27:34] mod=syn|cli=10.98.248.43/50714|srv=54.172.129.97/443|subj=cli|os=Windows NT kernel|dist=0|params=generic|raw_sig=4:128+0:0:1460:mss*12,8:mss,nop,ws,nop,nop,sok:df,id+:0
p0f: [2018/05/10 20:27:34] mod=mtu|cli=10.98.248.43/50714|srv=54.172.129.97/443|subj=cli|link=Ethernet or modem|raw_mtu=1500
p0f: [2018/05/10 20:27:34] mod=syn+ack|cli=10.98.248.43/50714|srv=54.172.129.97/443|subj=srv|os=???|dist=22|params=none|raw_sig=4:42+22:0:1396:26883,7:mss,nop,nop,sok,nop,ws:id-:0

gpu example no longer builds

    ImportError: No module named 'setuptools'
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-s_qhbqew/absl-py/
You are using pip version 8.1.1, however version 18.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
The command '/bin/sh -c pip3 install numpy tensorflow-gpu' returned a non-zero code: 1

ext_types does not like * wildcard

It does not appear to match files or kickoff processing of followon modules.

2017-10-20T19:04:38+00:00 172.17.0.1 *[1929]: container_linux.go:265: starting container process caused "exec: \"/Users/u/vent_files/asldkfj.*\": permission denied"
2017-10-20T19:04:38+00:00 172.17.0.1 core[1929]: Error on line 434
2017-10-20T19:04:38+00:00 172.17.0.1 core[1929]: Failed to process job: 400 Client Error: Bad Request ("oci runtime error: container_linux.go:265: starting container process caused "exec: \"/Users/u/vent_files/asldkfj.*\": permission denied"
2017-10-20T19:04:38+00:00 172.17.0.1 core[1929]: ")
2017-10-20T19:04:38+00:00 172.17.0.1 core[1929]: {'d-grossman-vent-plugins-check-files-master:dd34346b4dd1c7f1b09de443f2bda9f0dab2caa2': {'volumes': {'/Users/u/vent_files': {'bind': '/Users/u/vent_files', 'mode': 'rw'}}}}
2017-10-20T19:04:38+00:00 172.17.0.1 core[1929]: (False, '400 Client Error: Bad Request ("oci runtime error: container_linux.go:265: starting container process caused "exec: \\"/Users/u/vent_files/asldkfj.*\\": permission denied"\n")')

Visualize a PCAP file as a graph

One of the challenges we have on the Poseidon team is gathering more data to train our ML models. A key part of that gathering is identifying (and labelling!) packet captures (pcaps) of specific device types. (e.g. X appears to be a TiVo, Y appears to be a Camera device, Z to be a Windows AD controller, etc.) One can of course achieve this using a combination of tools and approaches (including the use of p0f and Wireshark!), but there have been times when we have been sifting through pcaps that it hasn't been immediately obvious what a give node is.

We have found it useful to represent a node's communications as visual graph to help with identification. To-date we have done this manually using a a few steps:

  1. Converting the PCAP to a basic graph using the "brassfork" tool (which outputs a nodes.csv and edges.csv)
  2. Importing the two csv files from brassfork into Gephi
  3. Saving the Graph
  4. Being happy that it is now easier to figure out what you are looking at

What we would really like to do is take the above process, automate it, and replace Gephi with some generated graph visualization mechanism like Graphistry.

Plugin Testing

There is currently no uniform way to test plugins before loading them into vent. It would be useful to have a standard way to point to input files and their expected output, then run tests against that. The solution needs to be language agnostic.

Sharness might be a good fit:

Sharness is a portable shell library to write, run, and analyze automated tests for Unix programs. Since all tests output TAP, the Test Anything Protocol, they can be run with any TAP harness.

Here's an example of how Sharness is used by IPFS-go. Since it uses a standard output format (TAP) it would be a good excuse to add some plugins and visualization tools for that standard.

Create a Plugin That Translates CSV to RDF

Vent can handle plugins dumping files back into the input. It could be helpful to translate arbitrary files into RDF, so they can be combined as linked data. A CSV-to-RDF converter would be a good first step in that direction, and could be accomplished by simply wrapping Tarql. I'll take a look at this.

Plugin Logging

Looks like the current plugins have pretty minimal logging -- just printing to std out. How does Vent handle this output? Would it be valuable to pull together more verbose logs?

Action Required: Fix Renovate Configuration

There is an error with this repository's Renovate configuration that needs to be fixed. As a precaution, Renovate will stop PRs until it is resolved.

Error type: undefined. Note: this is a nested preset so please contact the preset author if you are unable to fix it yourself.

dshell tool no longer builds due to geoip file no longer at the same url

Step 7/17 : RUN wget http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz
 ---> Running in 7a4301cf99b2
--2019-01-11 18:12:42--  http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz
Resolving geolite.maxmind.com (geolite.maxmind.com)... 104.16.37.47, 104.16.38.47, 2606:4700::6810:262f, ...
Connecting to geolite.maxmind.com (geolite.maxmind.com)|104.16.37.47|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-01-11 18:12:42 ERROR 404: Not Found.

The command '/bin/sh -c wget http://geolite.maxmind.com/download/geoip/database/GeoLiteCountry/GeoIP.dat.gz' returned a non-zero code: 8

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.