There are a lot of issues in Crowbar due to the legacy of poor internals. This is blocking things quite a bit when it comes to improving Crowbar for adding new features. Let's fix it!

So far, 39 pull requests opened!

One source of truth for network configuration

This will significantly simplify the code, but also opens the door to changing the IP ranges used for networks.

See the following PRs:

• part 1:
  • https://github.com/crowbar/crowbar-core/pull/510
  • https://github.com/crowbar/crowbar-ha/pull/119 (merged after hackweek)
  • https://github.com/crowbar/crowbar-hyperv/pull/25
  • https://github.com/crowbar/crowbar-openstack/pull/415
• part 2:
  • https://github.com/crowbar/crowbar-ha/pull/120 (merged after hackweek)
  • https://github.com/crowbar/crowbar-core/pull/512 (merged after hackweek)
  • https://github.com/crowbar/crowbar-openstack/pull/417 (merged after hackweek)
  • MISSING: chef/cookbooks/bind9/recipes/default.rb:search(:crowbar, "id:*_network").each do |network|
• part 3:
  • https://github.com/crowbar/crowbar-core/pull/511

Continue move to role recipes (all merged)

This matters as this will solve a lot of issues caused by inconsistencies related to node state changes, and also because we can simplify things quite a bit.

See the following PRs:

• part 1:
  • https://github.com/crowbar/crowbar-core/pull/514 (merged)
  • https://github.com/crowbar/crowbar-ha/pull/121 (merged after hackweek)
  • https://github.com/crowbar/crowbar-ceph/pull/56 (merged)
  • https://github.com/crowbar/crowbar-openstack/pull/419 (merged)
• part 2:
  • https://github.com/crowbar/crowbar-core/pull/515 (merged after hackweek)
  • https://github.com/crowbar/crowbar-ha/pull/122 (merged after hackweek)

Rework automatic assignment of roles to new nodes (all merged)

This simplifies the code a lot, and also fix problems related to non-allocated nodes getting assigned some roles they don't need (which is causing issues when a barclamp needs to be re-applied, or when the non-allocated nodes get forgotten).

See the following PRs:

• https://github.com/SUSE-Cloud/automation/pull/1045 (merged after hackweek)
• https://github.com/crowbar/crowbar-core/pull/516 (merged after hackweek)
• https://github.com/crowbar/crowbar-openstack/pull/421 (merged after hackweek)
• https://github.com/crowbar/crowbar-ha/pull/123 (merged after hackweek)

Go towards no chef-client on boot

This is one step in the direction of not having chef-client run all the time, and therefore have Crowbar less invasive.

See the following PRs:

• https://github.com/crowbar/crowbar-ha/pull/124
• https://github.com/crowbar/crowbar-core/pull/528 (merged after hackweek)

Unsubmitted changes:

• In order to validate that we don't need to reconfigure everything on boot, I deployed a cloud, with most roles disabled for the readying state, I disabled the chef-client service, and I rebooted the nodes. It seems that we're doing a good job at making the config persistent on disk, without a need for chef:
  • all openstack roles are good
  • in crowbar-core, most roles are good. I didn't check dns-client (currently configured to be running for "all" states, sounds wrong), crowbar (only matters for admin server anyway), deployer-client (required for ohai data to be updated), ipmi-discover (might be needed to update the ipmi data on boot), network (this needs some more attention, as there's code to kill NICs not managed by crowbar on boot)
  • MISSING: crowbar-ceph roles, crowbar-ha roles (especially with drbd)
• Conclusion is that we don't need most of the roles on boot.
• See https://github.com/vuntz/crowbar-core/commits/no-readying and https://github.com/vuntz/crowbar-openstack/commits/no-readying

Go towards minimum amount of recipes on each chef-client run

We want to have Crowbar less invasive, and part of this is to not have chef reconfigure everything every time.

See the following PRs:

• https://github.com/crowbar/crowbar-ha/pull/125
• https://github.com/crowbar/crowbar-core/pull/535 (merged after hackweek)

Unsubmitted branches (WIP):

• https://github.com/vuntz/crowbar-core/tree/fast-batch
• https://github.com/vuntz/crowbar-openstack/tree/no-undef-resource

Go towards no periodic chef-client run

We want to have Crowbar less invasive, and part of this is to not have chef reconfigure everything every time.

No code yet, but some thoughts. Currently, periodic chef-client runs are useful for:

• heartbeat through ohai data (from deployer-client role)
  • we might keep the periodic run just for this; if we do that, we would only run this in "ready" state, and instead add a "converging" state that would allow to run all roles
• updating config of a service, when another service is changed on another node (for instance: making sure the neutron config is up-to-date on nova-compute nodes)
  • this should be handled through a trigger mechanism when applying a barclamp
• reconfiguring the repos on the nodes when updating the list of repos in crowbar webui
  • this should be handled through a trigger mechanism
• updating the config on nodes after editing one node (changing alias, public name, availability zone) -- including dns config on dns-server
  • this should be handled through a trigger mechanism when changing some attributes; however, we need to be clever as changing the public name of a controller is important for nearly all nodes while changing the public name of a compute node doesn't matter

General cleanup of code (all merged)

See the following PRs:

• https://github.com/crowbar/crowbar-core/pull/519 (merged after hackweek)
• https://github.com/crowbar/crowbar-core/pull/530 (merged after hackweek)
• https://github.com/crowbar/crowbar/pull/2236 (merged after hackweek)
• https://github.com/crowbar/crowbar/pull/2237 (merged after hackweek)

VXLAN with Linuxbridge (all merged)

This is a request we've got several times, so here it is.

See the following PRs:

• https://github.com/crowbar/crowbar-openstack/pull/424 (merged after hackweek)
• https://github.com/SUSE-Cloud/automation/pull/1046 (merged after hackweek)
• https://github.com/crowbar/crowbar-openstack/pull/425 (backport to 3.0 branch) (merged after hackweek)

Various bug fixes (all merged)

See the following PRs:

• https://github.com/crowbar/crowbar-core/pull/518 (merged)
• https://github.com/crowbar/crowbar-core/pull/520 (merged)
• https://github.com/crowbar/crowbar-core/pull/521 (merged)
• https://github.com/crowbar/crowbar-openstack/pull/423 (merged)
• https://github.com/crowbar/crowbar-core/pull/525 (merged)
• https://github.com/crowbar/crowbar-openstack/pull/426 (merged)
• https://github.com/crowbar/crowbar-openstack/pull/427 (merged after hackweek)
• https://github.com/crowbar/crowbar-openstack/pull/428 (merged)
• https://github.com/crowbar/crowbar-core/pull/529 (merged after hackweek)
• https://github.com/crowbar/crowbar-core/pull/536 (merged after hackweek)