Bonzai is Scortex python library handling everything related to deep learning on images.
Bonzai is built on top of keras / tensorflow. It uses as input a connection to a mongo database for annotations and meta-information (dates, part reference, acquisition system version, ...), as well as an azure filesystem for images storing. The main output is the production of deep learning model in tf.keras format (topology in .json and weights in .h5).
With this library, Scortex engineers manipulate and clean images and their metadata. They use it to train deep learning models and evaluate properly these models.
Below is an example image from our unsupervised anomaly detection demonstrator.
The user can train a model with a few un-annoted images and the model will detect anomalies.
The result shows the original image with a defect score and a defect localization. Here is detects a tiny pen mark on the business card the model was trained on.
Example of detections on our supervised demonstrator (less constrained). The part goes on the conveyor belt. Inside the Scortex dark “box” there are 2 cameras filming continuously 1920x1200 colored images. One report is created per part. The (defect) detection are shown with closeups on the bottom of the screen.
There is currently no frontend to train supervised models using only the mouse but we are hoping to be able to work on this in 2021.