Today I gave a presentation on Embedded AI at the Edge to the Akron Linux Users Group. The focus of the discussion centered around the use of Large Language Models in embedded systems. We delved into how LLMs work through the use of the Transformer Architecture, as seen on the left. A demo of a working LLM running on a microcontroller was shared with the group.
Here is a link to the presentation.