Welcome back to my attempts to save a trained TensorFlow model in Python and load it in C/C++. Part 1 documented how I kept running into that word deprecated in the TensorFlow library. The conclusion was that the SavedModel format was going to remain in TensorFlow 2.0, but all the functions in TensorFlow 1.x for … Continue reading Saving and loading TensorFlow neural networks Part 2: ONNX to the rescue
If, like me, you're looking for a C/C++ method and think that TF Serving is overkill, I couldn't find an abolutely guaranteed route to success. However, the best seems to be to convert to ONNX format and use an ONNX runtime to use the model for inference. Part 2 of this series of posts will cover my attempts to create a tutorial on how to do this.