Giter Club home page Giter Club logo

xcp-networkd's Introduction

  • manages clusters of Xen hosts as single entities
  • allows running VMs to be migrated between hosts (including with storage) with minimal downtime
  • automatically restarts VMs after host failure ("High Availability")
  • facilitates disaster recovery cross-site
  • simplifies maintainence through rolling pool upgrade
  • collects performance statistics for historical analysis and for alerting
  • has a full-featured XML-RPC based API, used by clients such as XenCenter, Xen Orchestra, OpenStack and CloudStack

The xapi toolstack is developed by the xapi project: a sub-project of the Linux Foundation Xen Project.

Contents

  • Architecture: read about how the components of the xapi toolstack work together
  • Features: learn about the features supported by xapi and how they work.
  • Designs: explore designs for cross-cutting features.
  • Xen API documentation: explore the Xen API
  • Futures: find out how the xapi toolstack is likely to change and how you can help.
  • Xapi project: learn about the xapi project on the Xen wiki

Components

  • Xapi: manages a cluster of Xen hosts, co-ordinating access to network and storage.
  • Xenopsd: a low-level "domain manager" which takes care of creating, suspending, resuming, migrating, rebooting domains by interacting with Xen via libxc and libxl.
  • Xcp-rrdd: a performance counter monitoring daemon which aggregates "datasources" defined via a plugin API and records history for each.
  • Xcp-networkd: a host network manager which takes care of configuring interfaces, bridges and OpenVSwitch instances
  • Squeezed: a single host ballooning daemon which "balances" memory between running VMs.
  • SM: Storage Manager plugins which connect Xapi's internal storage interfaces to the control APIs of external storage systems.

xcp-networkd's People

Contributors

akshayramani avatar alexz avatar andyhhp avatar avsm avatar blp avatar citrix-openstack-jenkins-xx avatar djs55 avatar edwintorok avatar ejj avatar jjd27 avatar johnelse avatar jonathanknowles avatar jonludlam avatar krizex avatar lindig avatar matthiasgoergens avatar mg12ctx avatar mietek avatar mseri avatar psafont avatar rabink avatar robhoes avatar samoht avatar sharady avatar siddharthv avatar simonjbeaumont avatar thomassa avatar xiewei20082008 avatar yarsincitrix avatar zli avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

xcp-networkd's Issues

Mysterious crash (on ARM)

Program received signal SIGILL, Illegal instruction.
[Switching to Thread 0xb6c3f460 (LWP 14927)]
0xb6d22358 in ?? ()
(gdb) 
(gdb) 
(gdb) 
(gdb) 
(gdb) bt
#0  0xb6d22358 in ?? ()
#1  0x0019c0e0 in caml_start_program ()
#2  0x0019a54a in caml_callback ()
#3  0x00000000 in ?? ()
(gdb) thread apply all bt

Thread 5 (Thread 0xb50ff460 (LWP 14954)):
#0  0xb6fb961e in read () at ../sysdeps/unix/syscall-template.S:81
#1  0x00195042 in caml_do_read ()
#2  0x0019524e in caml_input_scan_line ()
#3  0x00195ad8 in caml_ml_input_scan_line ()
#4  0x0019c098 in caml_c_call ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)

Thread 4 (Thread 0xb5c3f460 (LWP 14929)):
#0  0xb6fb961e in read () at ../sysdeps/unix/syscall-template.S:81
#1  0x00195042 in caml_do_read ()
#2  0x0019524e in caml_input_scan_line ()
#3  0x00195ad8 in caml_ml_input_scan_line ()
#4  0x0019c098 in caml_c_call ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)

Thread 3 (Thread 0xb643f460 (LWP 14928)):
#0  0xb6edf0f2 in select () at ../sysdeps/unix/syscall-template.S:81
#1  0x0018b502 in caml_thread_tick ()
#2  0xb6fb3fbc in start_thread (arg=0xb643f460) at pthread_create.c:314
#3  0xb6ee398c in ?? () at ../ports/sysdeps/unix/sysv/linux/arm/nptl/../clone.S:92 from /lib/arm-linux-gnueabihf/libc.so.6
Backtrace stopped: previous frame identical to this frame (corrupt stack?)

Thread 2 (Thread 0xb6c3f460 (LWP 14927)):
#0  0xb6d22358 in ?? ()
#1  0x0019c0e0 in caml_start_program ()
#2  0x0019a54a in caml_callback ()
#3  0x00000000 in ?? ()

Thread 1 (Thread 0xb6ff8000 (LWP 14924)):
#0  0xb6edf0f2 in select () at ../sysdeps/unix/syscall-template.S:81
#1  0x0018d89e in unix_select ()
#2  0x0019c098 in caml_c_call ()
Backtrace stopped: previous frame identical to this frame (corrupt stack?)
(gdb) 

Network_interface.Internal_error("Not_found") - /proc/net/bonding/

For some reasons running
xe pif-scan host-uuid=....

it looks for /proc/net/bonding/<bridge_interface_name> whilst it does not exist on normal system. Tested on cleanly installed system too.
System in question: Ubuntu 14.04 LTS, Xen 4.4 (amd64).
I'm guessing it might be related to:
#38

bridge setup in standard Linux way using brctl and properly visible at Xen level.

xe network-list
uuid ( RO) : 5369a468-f639-b7ec-ddc1-b1d5861da84e
name-label ( RW): Pool-wide network associated with em1
name-description ( RW):
bridge ( RO): brem1

em1 is standard ethernet interface.

xe pif-list
uuid ( RO) : b6a218d3-8f7b-f9cd-c1f1-3f16a63cc785
device ( RO): em1
currently-attached ( RO): true
VLAN ( RO): -1
network-uuid ( RO): 5369a468-f639-b7ec-ddc1-b1d5861da84e

trying to scan for interfaces:
xe pif-scan host-uuid=0d83e699-df0b-40db-9934-b5cbc9e5eafe
The server failed to handle your request, due to an internal error. The given message may give details useful for debugging the problem.

Syslog messages:
Jan 2 14:06:09 silver xcp-networkd: [error|silver|174|PIF.scan R:01e4a6892f20|network_utils] Error: could not read /proc/net/bonding/brem1.

Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi||cli] Xapi_cli.exception_handler: Got exception INTERNAL_ERROR: [ Network_interface.Internal_error("Not_found") ]

Full dump:
Jan 2 14:06:09 silver xapi: [ info|silver|1989 UNIX /var/lib/xcp/xapi||cli] xe pif-scan host-uuid=0d83e699-df0b-40db-9934-b5cbc9e5eafe username=root password=(omitted)
Jan 2 14:06:09 silver xapi: [ info|silver|1989 UNIX /var/lib/xcp/xapi|session.login_with_password D:a1aba3612cfd|xapi] Session.create trackid=25343f1677c75cc6c8b5dbee602036ba pool=false uname=root originator=cli is_local_superuser=true auth_user_sid= parent=trackid=9834f5af41c964e225f24279aefe4e49
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|session.login_with_password D:a1aba3612cfd|mscgen] xapi=>xapi [label="session.get_uuid"];
Jan 2 14:06:09 silver xapi: [debug|silver|1990 UNIX /var/lib/xcp/xapi||dummytaskhelper] task dispatch:session.get_uuid D:b7d7411afdb3 created by task D:a1aba3612cfd
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|audit] PIF.scan: host = '0d83e699-df0b-40db-9934-b5cbc9e5eafe (silver)'
Jan 2 14:06:09 silver xcp-networkd: [error|silver|174|PIF.scan R:01e4a6892f20|network_utils] Error: could not read /proc/net/bonding/brem1.
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|backtrace] Called from file "list.ml", line 55, characters 20-23\nCalled from file "xapi_pif.ml", line 261, characters 4-68\nCalled from file "xapi_pif.ml", line 479, characters 9-37\nCalled from file "message_forwarding.ml", line 233, characters 25-44\nCalled from file "rbac.ml", line 227, characters 16-23\n
Jan 2 14:06:09 silver xapi: 20150102T13:06:09.062Z|audit|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|audit ]' 'API' 'PIF.scan' (('host' 'silver' '0d83e699-df0b-40db-9934-b5cbc9e5eafe' 'OpaqueRef:0d0d7bf7-4d03-afc4-4280-8724014224ba')))
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|backtrace] Raised at file "rbac.ml", line 236, characters 10-15\nCalled from file "server_helpers.ml", line 75, characters 11-41\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|dispatcher] Server_helpers.exec exception_handler: Got exception INTERNAL_ERROR: [ Network_interface.Internal_error("Not_found") ]
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|dispatcher] Raised at file "rbac.ml", line 236, characters 10-15\nCalled from file "server_helpers.ml", line 75, characters 11-41\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|backtrace] Raised at file "rbac.ml", line 236, characters 10-15\nCalled from file "server_helpers.ml", line 75, characters 11-41\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|PIF.scan R:01e4a6892f20|xapi] Raised at file "server_helpers.ml", line 90, characters 14-15\nCalled from file "lib/pervasiveext.ml", line 22, characters 2-9\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|dispatch:PIF.scan D:a8b297444b68|xapi] Raised at file "lib/pervasiveext.ml", line 26, characters 22-25\nCalled from file "lib/debug.ml", line 57, characters 17-20\nRe-raised at file "lib/debug.ml", line 62, characters 10-11\nCalled from file "lib/pervasiveext.ml", line 22, characters 2-9\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi|dispatch:PIF.scan D:a8b297444b68|backtrace] Raised at file "lib/pervasiveext.ml", line 26, characters 22-25\nCalled from file "lib/debug.ml", line 57, characters 17-20\nRe-raised at file "lib/debug.ml", line 62, characters 10-11\nCalled from file "lib/pervasiveext.ml", line 22, characters 2-9\nRe-raised at file "lib/pervasiveext.ml", line 26, characters 22-25\nCalled from file "server_helpers.ml", line 136, characters 10-106\nCalled from file "server.ml", line 19252, characters 23-161\nCalled from file "server_helpers.ml", line 115, characters 4-7\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi||xapi] Raised at file "client.ml", line 6, characters 37-75\nCalled from file "client.ml", line 18, characters 55-110\nCalled from file "client.ml", line 8682, characters 6-53\nCalled from file "cli_operations.ml", line 3672, characters 10-45\nCalled from file "xapi_cli.ml", line 112, characters 18-56\nCalled from file "lib/pervasiveext.ml", line 22, characters 2-9\n
Jan 2 14:06:09 silver xapi: [ info|silver|1989 UNIX /var/lib/xcp/xapi|session.logout D:e73c5f0ec695|xapi] Session.destroy trackid=25343f1677c75cc6c8b5dbee602036ba
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi||backtrace] Raised at file "lib/pervasiveext.ml", line 26, characters 22-25\nCalled from file "xapi_cli.ml", line 111, characters 2-138\nCalled from file "xapi_cli.ml", line 221, characters 7-44\nCalled from file "xapi_cli.ml", line 273, characters 4-23\n
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi||cli] Xapi_cli.exception_handler: Got exception INTERNAL_ERROR: [ Network_interface.Internal_error("Not_found") ]
Jan 2 14:06:09 silver xapi: [debug|silver|1989 UNIX /var/lib/xcp/xapi||cli] Raised at file "lib/pervasiveext.ml", line 26, characters 22-25\nCalled from file "xapi_cli.ml", line 111, characters 2-138\nCalled from file "xapi_cli.ml", line 221, characters 7-44\nCalled from file "xapi_cli.ml", line 273, characters 4-23\n

Unguarded List.hd?

Against 0.9.3 attempting to bring up a VLAN:

Oct 30 14:10:55 brontitall xcp-networkd: [debug|brontitall|271|VLAN.create R:8442d0f031e0|network_server] Bringing up interf
ace brem2
Oct 30 14:10:55 brontitall xcp-networkd: [ info|brontitall|271|VLAN.create R:8442d0f031e0|network_utils] /sbin/ip link set b
rem2 up
Oct 30 14:10:55 brontitall xcp-networkd: [debug|brontitall|271|VLAN.create R:8442d0f031e0|network_server] Adding port em2 to
 bridge brem2 with interfaces em2
Oct 30 14:10:55 brontitall xcp-networkd: [debug|brontitall|271|VLAN.create R:8442d0f031e0|network_server] Bringing up interf
ace em2
Oct 30 14:10:55 brontitall xcp-networkd: [ info|brontitall|271|VLAN.create R:8442d0f031e0|network_utils] /sbin/ip link set e
m2 up
Oct 30 14:10:55 brontitall tapdisk[8275]: tapdisk-control: init, 10 x 4k buffers
Oct 30 14:10:55 brontitall tapdisk[8275]: I/O queue driver: lio
Oct 30 14:10:55 brontitall tapdisk[8275]: tapdisk-log: started, level 0
Oct 30 14:10:55 brontitall xcp-networkd: [debug|brontitall|271|VLAN.create R:8442d0f031e0|network_server] Creating bridge xa
pi1 (VLAN 12 on bridge brem2)
Oct 30 14:10:55 brontitall tapdisk[8275]: nbd: Set up local unix domain socket on path '/var/run/blktap-control/nbdclient827
5'
Oct 30 14:10:55 brontitall xcp-networkd: [ info|brontitall|271|VLAN.create R:8442d0f031e0|network_utils] /sbin/ip link set x
api1 address bc:30:5b:ce:ef:de
Oct 30 14:10:55 brontitall xapi: [debug|brontitall|24752 UNIX /var/lib/xcp/xapi|VLAN.create R:8442d0f031e0|backtrace] Raised
 at file \"ghost-location\", line 1, characters 0-0\nCalled from file \"nm.ml\", line 396, characters 3-54\nCalled from file
 \"network.ml\", line 30, characters 2-6\n
Oct 30 14:10:55 brontitall xapi: [error|brontitall|24752 UNIX /var/lib/xcp/xapi|VLAN.create R:8442d0f031e0|network] Caught I
NTERNAL_ERROR: [ Network_interface.Internal_error("Failure(\"hd\")") ] while trying to talk to xcp-networkd
Oct 30 14:10:55 brontitall xapi: [error|brontitall|24752 UNIX /var/lib/xcp/xapi|VLAN.create R:8442d0f031e0|network] Re-raisi
ng as PIF_CONFIGURATION_ERROR [ OpaqueRef:e1513f0d-cb72-1300-1405-4f4524def3a2;  ]

libnl has different names

On my Ubuntu box I had to install these packages:

apt-get install libnl-route-3-200
apt-get install libffi-dev
apt-get install libnl-3-200

and then create these additional symlinks

ln -s /lib/x86_64-linux-gnu/libnl-3.so.200 /lib/x86_64-linux-gnu/libnl-3.so
ln -s /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200 /usr/lib/x86_64-linux-gnu/libnl-route-3.so

before I could start xcp-networkd.

Support bond as management interface on firstboot.

Hi all!

I'm trying to solve this issue: basically some LACP switch are blocking if LACP is not already configured on the host. So i'd like to support port bonding at install.

I've modified our installer and xapi to support it, but the firstboot fails in read_management_conf when trying to find the mac address associated with bond0 from xapi doc i think i can take the mac address from a member of the bond, is that correct?

Also, read_management_conf returns among other things an interface_config and a bridge_config and i'm not sure how they should be defined in the bonding case. Could you help me? :)

Thanks

How to deal with SAN boot

Quick question for you @robhoes ๐Ÿ˜‰

We got a use case for a "complex" deployment using a "bare metal cloud" provider. In this case, we need to:

  • boot in UEFI
  • using iPXE (we chainload to Grub2, then Xen)
  • on iSCSI (SAN) for system drives

We managed to get it until host boot (also we improved our doc for this!). However, as soon xcp-networkd started, it's taking control on NICs, and cut the iSCSI connection.

Is there a way to tell xcp-networkd to leave the iSCSI NIC alone? (here, eth0 is the dedicated iSCSI NIC, and eth1 management).

Internal_error 'Not_found'

When 'xe pif-scan' (I think) on a host with a bridge already setup (br0) built from [mirage/xen-arm-builder]. No logs around atm since syslog is broken.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.