Riffdog Terraform / Reality scanner - finding 'things' in the Real World which
Terraform didn't put there.
One of the big challanges organisations have when rolling out Terraform, and indeed once it is rolled out, is what is and isn’t terraformed. In an ideal world, everything would be, but we are nearly always not in that world - for instance, you may have a mixture of resources, and there may have been emergency situations which someone ‘did’ something, and you need to identify the impact of that thing, and on top of this, there are situations where an operator or an admin just forgot, or didn’t know that this component was now Terraformed.
Riffdog allows you to compare the output from Terraform (its state files to be precise), against what is in the ‘real world’. So this works to find two things:
* Things that terraform thought it put there, that arn’t there any more * Things that people (or other systems) have put there, that Terraform doesn’t know about.
riffdog alternatives and similar packages
Based on the "DevOps Tools" category.
Alternatively, view riffdog alternatives based on common mentions on social networks and blogs.
10.0 9.9 L3 riffdog VS AnsibleAnsible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate everything from code deployment to network configuration to cloud management, in a language that approaches plain English, using SSH, with no agents to install on remote systems. https://docs.ansible.com.
9.7 9.7 L4 riffdog VS Docker ComposeDefine and run multi-container applications with Docker
9.7 9.3 L4 riffdog VS letsencryptCertbot is EFF's tool to obtain certs from Let's Encrypt and (optionally) auto-enable HTTPS on your server. It can also act as a client for any other CA that uses the ACME protocol.
9.5 9.9 L2 riffdog VS SaltStackSoftware to automate the management and configuration of any infrastructure or application at scale. Get access to the Salt software package repository here:
8.7 8.8 L2 riffdog VS BorgBackupDeduplicating archiver with compression and authenticated encryption.
6.8 0.8 L3 riffdog VS pexpectA Python module for controlling interactive programs in a pseudo-terminal
6.1 9.2 riffdog VS cloudinitOfficial upstream for the cloud-init: cloud instance initialization
pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of riffdog or a related project?
Riffdog Terraform / Reality scanner - finding 'things' in the Real World which Terraform didn't put there.
This project works by firstly loading your terraform state files - not your terraform files, and building a memory object that represents what terraform thinks it has deployed. The second step is then to access your environment and actually look what is there, and it builds another memory object.
Then it compares the two, and looks for:
- Things that TF put there, but arn't there
- Things that are there, that TF doesn't know about
For this to work, you must install a resouce pack, for instance
Command line vs Library
Riffdog is both a command line tool and a python library. The command line tool basically creates a config object and calls the scan method.
To install (for example with the AWS resources)
$ pip install riffdog[aws]
$ riffdog -b bucketname_containing_states
For full command line reference, please see the docs #FIXME - link to docs!
Light vs Full Scan mode
AWS and Terraform are very complex: for instance, a EC2 instance is a computer, a collection of network cards, volumes, etc. In 'light' mode, we do a high level scan to see if all the main components are there - in 'full' mode, it inspects all elements (as far as RiffDog is aware of, see below) - i.e. checks that all network cards, volumes, etc are mounted as intended.
Its important to realise that not all infrastructure is deployed via TF - for instance auto scaling, or service discovery systems may be interacting with your infrastructure, and this is OK, but you don't want RiffDog raising alerts on those.
This is pretty much always a work under development, as AWS adds more features modules etc. The system is designed to be modular, but we're only able to keep up with modules that we use - so if you use a feature of AWS that we don't scan please feel free to add a module. If you need help, please contact us or file a ticket.
Automated testing of this system is quite difficult. Ultimatly these are here to make sure that changes to internal data structures do not break other functions (e.g. some data objects such as network interfaces are used by multiple features: both EC2 instances and Lambdas). The real test is whether it works against the current Terraform and AWS API's, not a snapshot from previous years.
- Tests go into the tests folder,
- Tox is used to make sure compatibility with various versions of python & libraries