Mastodon discussion Discussions Apr 13 4 views

Put together this "Toward Multimodal #AI" explainer widget. Starts with a motivation for why #ViT's over CNN's, introduc...

by Ted Pavlic (he/him)

Put together this "Toward Multimodal #AI" explainer widget. Starts with a motivation for why #ViT's over CNN's, introduces joint embedding spaces (like #CLIP), and then shows how to adapt those spaces as inputs to #LLM's for true multimodal reasoning.https://tpavlic.github.io/asu-bioinspired-ai-and-optimization/transformers/toward_multimodal_AI.html

Read Original
Multimodal

Metadata

Reblogs Count
1
Account
tedpavlic@mas.to

Related