TGViewer
๐Ÿ‡ฐ๐Ÿ‡ท Lagrange | ๋ผ๊ทธ๋ž‘์ฃผ ํ•œ๊ตญ ๊ณต์ง€์ฑ„๋„ ๐Ÿ‡ฐ๐Ÿ‡ท Lagrange | ๋ผ๊ทธ๋ž‘์ฃผ ํ•œ๊ตญ ๊ณต์ง€์ฑ„๋„ @lagrangekr ยท 2.26K subscribers
Post #182 2.25K
๐Ÿ• ๋ผ๊ทธ๋ž‘์ฃผ, Engineering Updates

๋ผ๊ทธ๋ž‘์ฃผ์˜ ์—ฐ๊ตฌยท๊ฐœ๋ฐœยท์—”์ง€๋‹ˆ์–ด๋ง ์ตœ์‹  ์†Œ์‹์„ ํ•œ๋ˆˆ์— ๋ณผ ์ˆ˜ ์žˆ๋Š” ๊ฐ€์ด๋“œ ๐Ÿ‘จโ€๐Ÿ”ฌ

๐Ÿ“Œ 7์›” ์ฃผ์š” ์†Œ์‹

DeepProve๋Š” GPT-2 ์ „์ฒด ์ถ”๋ก  ์•”ํ˜ธํ•™์  ์ฆ๋ช…์— ์„ฑ๊ณตํ•˜๋ฉฐ ์„ธ๊ณ„ ์ตœ์ดˆ ํ”„๋กœ๋•์…˜ ๋ ˆ๋”” zkML ์‹œ์Šคํ…œ์œผ๋กœ ๋„์•ฝํ–ˆ์Šต๋‹ˆ๋‹ค.

๋‹ค์Œ ๋ชฉํ‘œ๋Š” LLAMA ํ˜ธํ™˜์„ฑ๊ณผ ๊ณ ์„ฑ๋Šฅยท๋Œ€๊ทœ๋ชจ LLM ์ฆ๋ช…์ž…๋‹ˆ๋‹ค.

โšก๏ธ DeepProve ์ฃผ์š” ์—…๋ฐ์ดํŠธ

ยท Computational Graph ์ง€์› โ†’ Transformer Residual ๋“ฑ ๋ณต์žกํ•œ ๋ชจ๋ธ ๊ตฌ์กฐ ํ˜ธํ™˜
ยท GGUF ํฌ๋งท ์ง€์› โ†’ Hugging Face ๋“ฑ ์ปค๋ฎค๋‹ˆํ‹ฐ ๋ชจ๋ธ๊ณผ ํ˜ธํ™˜์„ฑ ๊ฐ•ํ™”
ยท LLM Inference Engine ๊ตฌ์ถ• โ†’ ์˜คํ† ๋ฆฌ๊ทธ๋ ˆ์‹œ๋ธŒ ์ถ”๋ก  ๋ฐ ํ† ํฐ ๋‹จ์œ„ ์ฆ๋ช… ์ง€์›
ยท Transformer ํ•ต์‹ฌ ์—ฐ์‚ฐ ๋ ˆ์ด์–ด ์ถ”๊ฐ€ โ†’ Softmax, LayerNorm, GELU, QKV Attention ๋“ฑ

๐Ÿฅบ ํ˜„์žฌ ์ง‘์ค‘ ๊ณผ์ œ

ยท ์„ฑ๋Šฅ ์ตœ์ ํ™” โ†’ ์ฆ๋ช… ์†๋„, ๋ฉ”๋ชจ๋ฆฌ ์‚ฌ์šฉ๋Ÿ‰, ์ฆ๋ช… ํฌ๊ธฐ ๊ฐœ์„ 
ยท ์•”ํ˜ธํ•™์  ๊ฐœ์„  โ†’ Groth16 ๊ธฐ๋ฐ˜ PCS ๋ฒค์น˜๋งˆํฌ ๋ฐ Lookup Table ์žฌ์‚ฌ์šฉ ์ตœ์ ํ™”
ยท ๋ณ‘๋ ฌํ™” ๋ฐ ๋ถ„์‚ฐ ์ฆ๋ช… โ†’ DAG ๊ธฐ๋ฐ˜ ์—ฐ์‚ฐ ๋ณ‘๋ ฌ ์ฒ˜๋ฆฌ, ๋ฉ€ํ‹ฐ์ฝ”์–ด ํ™œ์šฉ, ๋…ธ๋“œ ๊ฐ„ ๋ถ„์‚ฐ ์ฆ๋ช… ์ง€์›

๐Ÿšถโ€โ™‚๏ธ ๋‹ค์Œ ๋‹จ๊ณ„

ยท Meta LLAMA ์ง€์› ์ค€๋น„ โ†’ RMSNorm, SILU, Grouped Attention ๋“ฑ ์‹ ๊ทœ ๋ ˆ์ด์–ด ํ†ตํ•ฉ ์˜ˆ์ •
ยท ์„ฑ๋Šฅ ์ตœ์ ํ™” โ†’ proving ์†๋„ ํ–ฅ์ƒ, ๋ฉ”๋ชจ๋ฆฌ ์ ˆ๊ฐ, ๋ถ„์‚ฐ ์ฆ๋ช… ๋ฐ ๋ฉ€ํ‹ฐ์ฝ”์–ด ๋ณ‘๋ ฌํ™” ์ถ”์ง„

DeepProve โ€” verifiability for the AI era. ๐Ÿง 

๐Ÿ“ฑ ์›๋ฌธ ๋ณด๊ธฐ
  • โค 2
More from @lagrangekr
  1. Oct 10, 2026๐Ÿ• ์—ฌ๋Ÿฌ๋ถ„์˜ ์ฐจ๋Š” ๊ด‘๊ณ ์—์„œ๋Š” ์ž์œจ์ฃผํ–‰์ด๋ผ๊ณ  ํ•˜๋ฉด์„œ ์—ฌ์ „ํžˆ ํ•ธ๋“ค์—์„œ ์†์„ ๋–ผ์ง€ ๋ง๋ผ๊ณ  ํ•ฉ๋‹ˆ๋‹ค ์•ˆ์ „ ๊ทœ์ œ ๋‹น๊ตญ์€ ์ด๋ฅผ ๋Œ€๋†“๊ณ  ๋งํ•ฉ๋‹ˆ๋‹ค. ๊ตฌ๋งคํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐ€์žฅ ๋†’์€โ€ฆ
  2. Oct 8, 2026๐Ÿ• ์†Œํ”„ํŠธ์›จ์–ด์˜ ๋ชจ๋“  ์‹ ๋ขฐ ๋ฉ”์ปค๋‹ˆ์ฆ˜์€ ํ•˜๋‚˜์˜ ์งˆ๋ฌธ์œผ๋กœ ๊ท€๊ฒฐ๋ฉ๋‹ˆ๋‹ค ๊ทธ ๊ธฐ๋ก์€ ๋ˆ„๊ฐ€ ๋งŒ๋“ค์—ˆ๋Š”๊ฐ€. ๋กœ๊ทธ๋Š” ์‹œ์Šคํ…œ์ด ์‚ฌํ›„์— ๋งŒ๋“ค๋ฉฐ ์‹œ์Šคํ…œ์ด ์“ฐ๊ธฐ๋กœ ์ •ํ•œ ๋‚ด์šฉ๋งŒ ๋‹ด๊ณ  ์žˆโ€ฆ
  3. Oct 7, 2026๐Ÿ• ๋ชจ๋“  ์ž์œจ ์‹œ์Šคํ…œ์€ ์–ธ์  ๊ฐ€, ๊ทธ ์‹œ์Šคํ…œ์ด ํ•œ ์ผ ์•„๋ž˜์— ํ•œ ์‚ฌ๋žŒ์ด ์ž๊ธฐ ์ด๋ฆ„์„ ๊ฑธ์–ด์•ผ ํ•˜๋Š” ์ˆœ๊ฐ„์— ์ด๋ฆ…๋‹ˆ๋‹ค ๋Œ€์‹œ๋ณด๋“œ๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค. ์„œ๋ช…์ž…๋‹ˆ๋‹ค. ์ฑ…์ž„์งˆ ์‚ฌ๋žŒ์ดโ€ฆ
  4. Oct 6, 2026๐Ÿ• OpenAI์˜ ํ•œ ๋ชจ๋ธ์—๊ฒŒ ๋น…ํ† ๋ฆฌ์•„์ฃผ๊ฐ€ ํ”ผ๋ถ€ ์งˆํ™˜ ์•ฝ์— ์–ผ๋งˆ๋ฅผ ์“ฐ๋Š”์ง€ ๋ฌผ์—ˆ์Šต๋‹ˆ๋‹ค ๊ทธ๋Ÿฐ๋ฐ ๊ทธ ๋ชจ๋ธ์€ ๋ฉ”๋””์ผ€์–ด(Medicare) ํฌํ„ธ ์•ˆ์œผ๋กœ ๋“ค์–ด๊ฐ€ ์ธ์ฆ ์ •๋ณด๋ฅผโ€ฆ
  5. Oct 5, 2026๐Ÿ• AI๊ฐ€ "ํ”„๋ผ์ด๋น—"ํ•˜๋‹ค๋Š” ์ธ์ฆ์„œ, ์ •๋ง ๋ฏฟ์–ด๋„ ๋ ๊นŒ์š”? AI ์ œ๊ณต์—…์ฒด๋Š” ์—ฌ๋Ÿฌ๋ถ„์˜ ์ฑ„ํŒ…์ด ๋น„๊ณต๊ฐœ์˜€์Œ์„ ์ฆ๋ช…ํ•˜๋Š” ์ธ์ฆ์„œ๋ฅผ ๋ณด์—ฌ์ค„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๊ทธ๋Ÿฐ๋ฐ ๊ทธ๋Ÿฐ ์ธ์ฆโ€ฆ
  6. Oct 2, 2026๐Ÿ• ์กฐ์ข…์‚ฌ ํ•œ ๋ช…์€ ๋“œ๋ก  ํ•œ ๋Œ€๋ฅผ ๋‚ ๋ฆด ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค ๋น„์œ ๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค: ์—ฐ๋ฐฉ ๊ทœ์ •์ƒ ํ•œ ์‚ฌ๋žŒ, ํ•œ ๋Œ€์˜ ํ•ญ๊ณต๊ธฐ์ด๋ฉฐ, ๊ทธ ์ด์ƒ์€ ๋ˆ„๊ตฐ๊ฐ€๊ฐ€ ์ง์ ‘ ์‹ ์ฒญํ•ด์„œ ๋ฐ›์•„์•ผ ํ•˜๋Š”โ€ฆ
Threads Profile ViewerView any public Threads profile without an account.Open ThreadLook โ†’Writing with AI? Make it sound human.Metric37 rewrites AI drafts so they read naturally. Free AI detector, 1,500 words free.Try Metric37 โ†’