Concrete ML v1.6: Bigger Neural Networks and Pre-trained Tree-based Models

Concrete ML v1.6 improves latency on large neural networks, adds support for pre-trained tree-based models and eases collaborative computation by introducing DataFrame schemas and by facilitating the deployment of logistic regression training. While GPU support will be available very soon in Concrete ML, some early latency results are given below.

Pre-trained tree-based models

Concrete ML has long supported the conversion of pre-trained linear models through [.c-inline-code]from_sklearn[.c-inline-code] and pre-trained neural networks using [.c-inline-code]compile_torch_model[.c-inline-code]. Pre-trained models are popular since training models from scratch is error-prone and requires more in depth machine learning knowledge. Furthermore, implementing specific training algorithms, such as federated learning, requires separate specialized toolkits, yet secure deployment of such trained models remains essential. The Concrete ML v1.6 now supports importing pre-trained tree models using the [.c-inline-code]from_sklearn[.c-inline-code] function. The default import settings ensure that accuracy is maintained on encrypted data, compared to using the original model in the clear. Refer to the documentation for more information.

Latency improvements

Two new notebooks showcase the latency improvements for pre-trained neural networks in Concrete v1.6

Deep MLP model: This notebook demonstrates a 20-layer deep MLP. It compiles a pre-trained model and executes with a latency of 1 second on encrypted data, 20x faster with a hpc7 AWS instance than the previous results from the Zama whitepaper .
ResNet18 model: This notebook demonstrates a ResNet18 model over ImageNet, executing on encrypted 256-pixel wide images. While the latency is approximately 56 minutes on GPUs, this model shows a 4x improvement over the state of the art of TFHE ML. The next release will enable end-user GPU support.

Deployment Enhancements

With Concrete ML v1.6, developers can easily deploy logistic regression training as a client-server service. As in previous versions, developers can parametrize the training system, selecting the number of features to be trained on and the training hyper-parameters. In addition, Concrete ML v1.6 allows for packaging the training circuit in order to deploy it on a cloud. See the encrypted training documentation for more details.

DataFrame schemas

The updated DataFrame API in Concrete v1.6 reduces the size of stored DataFrames and allows users to manually control the schema of the DataFrames they encrypt. Schemas describe the encrypted data, enabling multiple users to make their data compatible with each other. The feature is demonstrated in the encrypted DataFrame notebook.

The new features and improvements in this release improve the performance and the usability of Concrete ML. The forthcoming GPU support will bring even greater advancements in the near future. Stay tuned!