Azure Custom Vision
An Azure artificial intelligence service and end-to-end platform for applying computer vision to specific domains.
141 questions
Exported tensorflow lite is as large as tensorflow model
DemetrioScarfone-7181
0
Reputation points
Hi everyone,
I need a sub 10MB tensorflow lite model for offline image classification, the exported tflite is as large as the tensorflow (.pb) file, both 43MB.
The tflite float16 is 22MB, still twice as large as my requirement.
Something must be wrong as I'd have expected the tflite export to be smaller than the pb export.
Some details
- General (compact) [S1] domain
- Classification type: Multiclass (Single tag per image)
- 56 classes, about 3000 photos used for training
thanks for helping!
Best
{count} votes
-
Ramr-msft 12,176 Reputation points
2023-05-17T02:28:07.35+00:00 @DemetrioScarfone-7181 Thanks for the question. Can you add more information about the model architecture and the training process you used?
-
Ramr-msft 12,176 Reputation points
2023-05-31T16:14:24.43+00:00 @@DemetrioScarfone-7181 There are several techniques you can use to reduce the size of your TensorFlow Lite model for offline image classification:
Quantization: You can use post-training quantization to reduce the precision of the model weights from 32-bit floating point to 8-bit integers. This can significantly reduce the size of the model without sacrificing too much accuracy. You can also use quantization-aware training to train the model with quantization in mind, which can further reduce the size of the model.
Pruning: You can use weight pruning to remove the least important weights from the model. This can reduce the size of the model without sacrificing too much accuracy. You can also use structured pruning to remove entire filters or channels from the model, which can further reduce the size of the model.
Knowledge distillation: You can use knowledge distillation to train a smaller student model to mimic the behavior of a larger teacher model. This can reduce the size of the model while maintaining most of its accuracy.
Architecture optimization: You can use architecture optimization techniques such as neural architecture search to find a smaller and more efficient model architecture that achieves similar accuracy to your current model.
Compression: You can use compression techniques such as weight sharing, Huffman coding, or arithmetic coding to further reduce the size of the model.
You can try one or more of these techniques to reduce the size of your TensorFlow Lite model to below 10MB. Keep in mind that reducing the size of the model may also affect its accuracy, so you may need to experiment with different techniques and find the right balance between size and accuracy for your use case.
Sign in to comment