The first and most important optimization you can do for any modern deep learning system, generally speaking, is to implement batching.
Hey Fin, I know being a Dad must be crazy, but are you going to continue this Newsletter?
I plan to! I have a new article that’s almost done, just needs some polishing. My toddler has stopped sleeping so that has severely cut into my blogging time, unfortunately.
hi, why magic number is 216 ? 65TFLOPS / (2 * 300gb/s) = 108
Hey Fin, I know being a Dad must be crazy, but are you going to continue this Newsletter?
I plan to! I have a new article that’s almost done, just needs some polishing. My toddler has stopped sleeping so that has severely cut into my blogging time, unfortunately.
hi, why magic number is 216 ? 65TFLOPS / (2 * 300gb/s) = 108