Mastodon discussion May 10

Avi Chawla (@_avichawla)ํ”„๋กฌํ”„ํŠธ ์—”์ง€๋‹ˆ์–ด๋ง, RAG, ์ปจํ…์ŠคํŠธ ์—”์ง€๋‹ˆ์–ด๋ง, ํŒŒ์ธํŠœ๋‹, ์—์ด์ „ํŠธ, LLM ๋ฐฐํฌ/์ตœ์ ํ™”, ์•ˆ์ „์„ฑยทํ‰๊ฐ€ยท๊ด€์ธก์„ฑ๊นŒ์ง€ ํฌํ•จํ•œ ํ’€์Šคํƒ AI ์—”์ง€๋‹ˆ์–ด๋ง ๋กœ๋“œ๋งต์„ ์†Œ๊ฐœํ•ฉ๋‹ˆ๋‹ค. ๋ฌด...

Avi Chawla (@_avichawla)ํ”„๋กฌํ”„ํŠธ ์—”์ง€๋‹ˆ์–ด๋ง, RAG, ์ปจํ…์ŠคํŠธ ์—”์ง€๋‹ˆ์–ด๋ง, ํŒŒ์ธํŠœ๋‹, ์—์ด์ „ํŠธ, LLM ๋ฐฐํฌ/์ตœ์ ํ™”, ์•ˆ์ „์„ฑยทํ‰๊ฐ€ยท๊ด€์ธก์„ฑ๊นŒ์ง€ ํฌํ•จํ•œ ํ’€์Šคํƒ AI ์—”์ง€๋‹ˆ์–ด๋ง ๋กœ๋“œ๋งต์„ ์†Œ๊ฐœํ•ฉ๋‹ˆ๋‹ค. ๋ฌด๋ฃŒ ์˜คํ”ˆ์†Œ์Šค ์ž๋ฃŒ๋„ ํ•จ๊ป˜ ์ œ๊ณต๋˜์–ด AI ๊ฐœ๋ฐœ์ž์—๊ฒŒ ์œ ์šฉํ•ฉ๋‹ˆ๋‹ค.https://x.com/_avichawla/s...

Mastodon discussion May 9

Show HN: Nexa-gauge โ€“ Cache/cost-aware graph-based eval for LLM and RAGNexa-gauge๋Š” LLM, RAG, ์—์ด์ „ํŠธ ์‹œ์Šคํ…œ์˜ ์ƒ์„ฑ ๊ฒฐ๊ณผ๋ฅผ ํ‰๊ฐ€ํ•˜๊ธฐ ์œ„ํ•œ ํŒŒ์ด...

Show HN: Nexa-gauge โ€“ Cache/cost-aware graph-based eval for LLM and RAGNexa-gauge๋Š” LLM, RAG, ์—์ด์ „ํŠธ ์‹œ์Šคํ…œ์˜ ์ƒ์„ฑ ๊ฒฐ๊ณผ๋ฅผ ํ‰๊ฐ€ํ•˜๊ธฐ ์œ„ํ•œ ํŒŒ์ด์ฌ ํŒจํ‚ค์ง€์ด์ž CLI ๋„๊ตฌ๋กœ, ๊ทธ๋ž˜ํ”„ ๊ธฐ๋ฐ˜ ํ‰๊ฐ€ ํŒŒ์ดํ”„๋ผ์ธ์„ ํ†ตํ•ด ๋ฐ˜๋ณต ๊ฐ€๋Šฅํ•œ ํ’ˆ์งˆ ์ง€ํ‘œ์™€ ๋น„์šฉ ์ถ”์ •, ์บ์‹œ...

Dev.to tutorial May 9

You're doing RAG wrong

There's a new approach that: cuts corpus size by 40x. reduces tokens per query by 3x. improves vector...

Mastodon discussion May 9

Engineering Intelligence from Autocomplete์ด ๊ธ€์€ LLM์ด ๋‹จ์ˆœํ•œ ๋‹ค์Œ ๋‹จ์–ด ์˜ˆ์ธก๊ธฐ์ž„์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ , ์ ์ ˆํ•œ ์ œ์•ฝ ์กฐ๊ฑด(ํ”„๋กฌํ”„ํŠธ, RAG, ๋„๊ตฌ ์‚ฌ์šฉ, ์˜จ๋„ ์กฐ์ ˆ)์„ ํ†ตํ•ด ๋ณต์žกํ•œ ๋ฌธ์ œ...

Engineering Intelligence from Autocomplete์ด ๊ธ€์€ LLM์ด ๋‹จ์ˆœํ•œ ๋‹ค์Œ ๋‹จ์–ด ์˜ˆ์ธก๊ธฐ์ž„์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ , ์ ์ ˆํ•œ ์ œ์•ฝ ์กฐ๊ฑด(ํ”„๋กฌํ”„ํŠธ, RAG, ๋„๊ตฌ ์‚ฌ์šฉ, ์˜จ๋„ ์กฐ์ ˆ)์„ ํ†ตํ•ด ๋ณต์žกํ•œ ๋ฌธ์ œ ํ•ด๊ฒฐ์ด ๊ฐ€๋Šฅํ•ด์ง€๋Š” ์›๋ฆฌ๋ฅผ ์„ค๋ช…ํ•œ๋‹ค. ํŠนํžˆ ์ฑ—๋ด‡ ๊ตฌํ˜„ ์‹œ LLM์ด ์ƒํƒœ๋ฅผ ๊ธฐ์–ตํ•˜์ง€ ์•Š์œผ๋ฏ€๋กœ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์ด ๋Œ€...

Mastodon discussion May 9

S Banerjee (@SB434223)RAG์—์„œ ์ž„๋ฒ ๋”ฉ ํ’ˆ์งˆ๋งŒ์œผ๋กœ๋Š” ์ถฉ๋ถ„ํ•˜์ง€ ์•Š์œผ๋ฉฐ, ๋ฐ์ดํ„ฐ๊ฐ€ ์ปค์งˆ์ˆ˜๋ก ๊ฒ€์ƒ‰ ๊ณต๊ฐ„์ด ์กฐ๋ฐ€ํ•ด์ ธ โ€˜๊ฑฐ์˜ ๊ด€๋ จ ์žˆ๋Š”โ€™ ๋ฌธ์„œ๊ฐ€ ๋Š˜๊ณ  recall์ด ๋–จ์–ด์ง„๋‹ค๋Š” ์ ์„ ๊ฐ•์กฐํ•œ๋‹ค. ๋”ฐ๋ผ์„œ ๋Œ€๊ทœ๋ชจ ...

S Banerjee (@SB434223)RAG์—์„œ ์ž„๋ฒ ๋”ฉ ํ’ˆ์งˆ๋งŒ์œผ๋กœ๋Š” ์ถฉ๋ถ„ํ•˜์ง€ ์•Š์œผ๋ฉฐ, ๋ฐ์ดํ„ฐ๊ฐ€ ์ปค์งˆ์ˆ˜๋ก ๊ฒ€์ƒ‰ ๊ณต๊ฐ„์ด ์กฐ๋ฐ€ํ•ด์ ธ โ€˜๊ฑฐ์˜ ๊ด€๋ จ ์žˆ๋Š”โ€™ ๋ฌธ์„œ๊ฐ€ ๋Š˜๊ณ  recall์ด ๋–จ์–ด์ง„๋‹ค๋Š” ์ ์„ ๊ฐ•์กฐํ•œ๋‹ค. ๋”ฐ๋ผ์„œ ๋Œ€๊ทœ๋ชจ RAG์—์„œ๋Š” reranking ๊ฐ™์€ ํ›„์ฒ˜๋ฆฌ์™€ ๊ฒ€์ƒ‰ ์„ค๊ณ„๊ฐ€ ์ค‘์š”ํ•˜๋‹ค๋Š” ๊ธฐ์ˆ ์  ์ธ์‚ฌ์ดํŠธ๋ฅผ ์ œ์‹œํ•œ๋‹ค.https:/...