Data Flow Facilitator for Machine Learning (dffml) v0.3.1 Release Notes

Release Date: 2019-12-12 // almost 2 years ago
  • โž• Added

    • โœ… Integration tests using the command line interface.
    • โœ… Operation run_dataflow to run a dataflow and test for the same. ### ๐Ÿ”„ Changed
    • ๐Ÿ”‹ Features were moved from ModelContext to ModelConfig
    • CI is now run via GitHub Actions
    • โœ… CI testing script is now verbose
    • args and config methods of all classes no longer require implementation. BaseConfigurable handles exporting of arguments and creation of config objects for each class based off of the CONFIG property of that class. The CONFIG property is a class which has been decorated with dffml.base.config to make it a dataclass.
    • ๐Ÿ”Œ Speed up development service install of all plugins in development mode
    • ๐Ÿ”Œ Speed up named plugin load times ### ๐Ÿ›  Fixed
    • DataFlows with multiple possibilities for a source for an input, now correctly look through all possible sources instead of just the first one.
    • DataFlow MemoryRedundancyCheckerContext was using all inputs in an input set and all their ancestors to check redundancy (a hold over from pre uid days). It now correctly only uses the inputs in the parameter set. This fixes a major performance issue.
    • MySQL packaging issue.
    • Develop service running one off operations correctly json-loads dict types.
    • Operations with configs can be run via the development service
    • JSON dumping numpy int* and float* caused crash on dump.
    • CSV source always loads src_urls as strings. ### โœ‚ Removed
    • ๐Ÿšš CLI command operations removed in favor of dataflow run
    • Duplicate dataflow diagram code from development service