Skip to content
Shinhan-Hackaton-Team-HMHPublic

Latest commit

ย 

History

145 Commits

Folders and files

Repository files navigation

Slide 16_9 - 43 (2)

๐Ÿ–ฅ๏ธ Project Overview

  • ํ”„๋กœ์ ํŠธ ์ด๋ฆ„: ์ž์˜์—…์ž๋„ ์†์‰ฝ๊ฒŒ ๊ด‘๊ณ  ์ œ์ž‘๋ถ€ํ„ฐ ์ง‘ํ–‰, ๊ด‘๊ณ  ๊ฒฐ๊ณผ๊นŒ์ง€ ์›์Šคํ†ฑ์œผ๋กœ ํ•ด๊ฒฐ ๊ฐ€๋Šฅํ•œ ์„œ๋น„์Šค โ€˜KT ๋ฐ”๋กœ๊ด‘๊ณ '
  • ํ”„๋กœ์ ํŠธ ๋ชฉ์ : KT ๋ฐ”๋กœ๊ด‘๊ณ ์˜ ๊ธฐ์กด ์›์Šคํ†ฑ ๊ด‘๊ณ  ์†”๋ฃจ์…˜์„ AI๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๊ด‘๊ณ  ์ง‘ํ–‰๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ๊ด‘๊ณ  ์ œ์ž‘ ์˜์—ญ๊นŒ์ง€ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์†Œ์ƒ๊ณต์ธ๋“ค์˜ ๊ด‘๊ณ  ์ง‘ํ–‰ ๊ณผ์ •์˜ ์ง„์ž… ์žฅ๋ฒฝ์„ ์™„ํ™”ํ•˜๊ณ , KT๋ฐ”๋กœ๊ด‘๊ณ ์˜ ์ƒˆ๋กœ์šด ์†”๋ฃจ์…˜์œผ๋กœ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ–ฅ๏ธ Team

  • ํŒ€ ์ด๋ฆ„: HMH ("ํ•˜๋ฉดํ•ด"๋ผ๋Š” ๋œป์˜ ๋ฐˆ์„ ์ฐจ์šฉํ•˜์—ฌ ์‹ ํ•œ์ฒญ๋…„ํ•ด์ปคํ†ค์—์„œ Gen Z์˜ ์ Š์€ ์—ด์ •, ๋„์ „์˜์‹, ํŒจ๊ธฐ๋ฅผ ๋ณด์—ฌ์ค๋‹ˆ๋‹ค)
  • ํŒ€ ๋ฉค๋ฒ„:
๐Ÿฐ๊น€์œ ๋ฆผ ๐Ÿปํ•œ์ •์šฑ ๐Ÿฑ์ด์—ฐ์ง„
ํŒ€์žฅ ํŒ€์› ํŒ€์›
Design FE BE

๐Ÿ–ฅ๏ธ Key Features

  1. ๊ด‘๊ณ  ์—…์ข…, ์†Œ์žฌ ์‹ฌ์˜ ์‹œ๋ฎฌ๋ ˆ์ด์…˜

    • ์‚ฌ์—…์ž๋“ฑ๋ก์ฆยท๊ด‘๊ณ  ์˜์ƒ ๋ถ„์„์œผ๋กœ ์—…์ข…ยท์†Œ์žฌ ์ ํ•ฉ์„ฑ ์‚ฌ์ „ ์ ๊ฒ€
  2. AI ํ™œ์šฉ ๊ด‘๊ณ  ์˜์ƒ ์ œ์ž‘

    • ๋„ค์ด๋ฒ„ ์ง€๋„ ๊ฐ€๊ฒŒ ๋งํฌ๋งŒ ์ž…๋ ฅํ•˜๋ฉด, ์ƒ์„ฑ๋œ ๊ด‘๊ณ  ์˜์ƒ ์ €์žฅ ํ›„ ๊ฐ€๊ฒŒ ํ™๋ณด์— ์žฌ์‚ฌ์šฉ ๊ฐ€๋Šฅ
  3. ์‚ฌ์šฉ์ž ์ฐธ์—ฌํ˜• ๊ด‘๊ณ  QR

    • QR ๊ธฐ๋ฐ˜ ์ธํ„ฐ๋ž™ํ‹ฐ๋ธŒ ๊ด‘๊ณ : ๊ณ ๊ฐ ์ฐธ์—ฌ ๋ฐ์ดํ„ฐ์™€ ๊ด‘๊ณ  ์„ฑ๊ณผ ์ธก์ •
  4. ๊ด‘๊ณ  ๋ฐ์ดํ„ฐ ๋ฆฌํฌํŠธ

    • QR ๋งํฌ ์ด์šฉ์ž ์ˆ˜ ํŠธ๋ž˜ํ‚น์œผ๋กœ ์‹ค์‹œ์ฒญ์ž ์ˆ˜ ์ •๋ณด ์ œ๊ณต

๐Ÿ–ฅ๏ธ Technology Stack

๐Ÿ‘‰๐Ÿป FE

Language
TypeScript
Framework ยท State ยท Data Fetching ยท Styling ยท Deploy
Next.js React Query Zustand Tailwind CSS Vercel

๐Ÿ‘‰๐Ÿป AI & Video

Language
Python
AI ยท Video Processing
Google%20Video%20Intelligence Vidu FFmpeg

๐Ÿ‘‰๐ŸปCooperation

Git GitHub

๐Ÿ–ฅ๏ธ Past presentation slides

Slide 16_9 - 5 Slide 16_9 - 65 (2) Slide 16_9 - 50 Slide 16_9 - 64

๐Ÿ–ฅ๏ธ Function Description

HMH_businessUpload.webm

์‚ฌ์—…์ž๋“ฑ๋ก์ฆ์˜ ์—…์ข…์„ ๊ธฐ๋ฐ˜์œผ๋กœ ์ ํ•ฉ์„ฑ์„ ์‚ฌ์ „์— ๊ฒ€์ฆ ๋ฐ ๊ตฌ๊ธ€์˜ OCR ๊ธฐ์ˆ ์„ ํ™œ์šฉํ•ด ํ…์ŠคํŠธ ์ž๋™ ์ถ”์ถœ

HMH_deviceSelection.webm

๊ด‘๊ณ ์ฃผ๊ฐ€ ๊ด‘๊ณ  ์ง€์—ญ, ์ผ์ • ,์˜ˆ์‚ฐ์„ ์ž…๋ ฅํ•˜๋ฉด AI๊ฐ€ ์—…์ข…, ์œ„์น˜, ์˜ˆ์‚ฐ ๋ฐ์ดํ„ฐ๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ ๊ด‘๊ณ ์ฃผ์—๊ฒŒ ์ตœ์ ํ™”๋œ ์†ก์ถœ๊ธฐ๊ธฐ๋ฅผ ์ถ”์ฒœ

HMH_AutoBudgetDistribution.webm

AI๊ฐ€ ์—…์ข…์— ๋งž๊ฒŒ ๋ถ„๋ฐฐํ•œ ์˜ˆ์‚ฐ ํ™•์ธ ํ›„ ๊ฒฐ์ œ

HMH_naverCrawlPage.webm

๋„ค์ด๋ฒ„ ํ”Œ๋ ˆ์ด์Šค์˜ ๊ฐ€๊ฒŒ ๋งํฌ์™€ ์˜์ƒ์—์„œ ๊ฐ•์กฐํ•˜๊ณ  ์‹ถ์€ ๊ฐ€๊ฒŒ ํ‚ค์›Œ๋“œ๋ฅผ ์ž…๋ ฅ

campaignProduction.mp4
  • ๊ด‘๊ณ ์ฃผ๊ฐ€ ์›ํ•˜๋Š” ๊ด‘๊ณ  ํ…œํ”Œ๋ฆฟ์„ ์„ ํƒํ•˜๊ณ , ๊ด‘๊ณ ์— ์‚ฌ์šฉํ•  ์‚ฌ์ง„ ์ถ”๊ฐ€๊ฐ€๋Šฅ
  • ์šฐ์ธก์— ํ‘œ์‹œ๋˜๋Š” ์ด๋ฏธ์ง€๋Š” ์•ž์„œ ์ž…๋ ฅํ•œ ๋„ค์ด๋ฒ„ ํ”Œ๋ ˆ์ด์Šค ๋งํฌ๋ฅผ ๊ธฐ์ค€์œผ๋กœ ํฌ๋กค๋ง๋œ ์‚ฌ์ง„์ด๋ฉฐ, ์‚ฌ์šฉ์ž๋Š” ์ด๋ฅผ ํ™•์ธํ•œ ๋’ค
    ๋ถˆํ•„์š”ํ•œ ์ด๋ฏธ์ง€๋ฅผ ์‚ญ์ œํ•˜๊ฑฐ๋‚˜ ์›ํ•˜๋Š” ์‚ฌ์ง„์„ ์ถ”๊ฐ€ํ•˜์—ฌ ์ตœ์ข…์ ์œผ๋กœ ๊ด‘๊ณ ์— ์‚ฌ์šฉํ•  ์ด๋ฏธ์ง€ ์„ ํƒ
  • ์‚ฌ์šฉ์ž๊ฐ€ ์ž…๋ ฅํ•œ ํ‚ค์›Œ๋“œ์™€ ๋„ค์ด๋ฒ„ ํ”Œ๋ ˆ์ด์Šค์˜ ์ •๋ณด๋ฅผ ๊ธฐ๋ฐ˜์œผ๋กœ AI๊ฐ€ ์ž๋™์œผ๋กœ ๊ด‘๊ณ ๋ฌธ๊ตฌ ์ƒ์„ฑ
default.mp4

๊ธฐ์—…์ธก์—์„œ ์‚ฌ์šฉํ•˜๋Š” ๋น„๋””์˜ค ๋ถ„์„ ๋ฆฌํฌํŠธ ffmpeg๋ฅผ ํ†ตํ•ด ๋ถ„์„ํ•œ ์˜์ƒ์˜ ๊ทœ๊ฒฉ ๋ฐ ํ•ด์ƒ๋„ ์ •๋ณด์™€ Google Cloud Video API๋ฅผ ํ™œ์šฉํ•œ ๊ฒ€์‚ฌ๊ฒฐ๊ณผ ํ™•์ธ ๊ฐ€๋Šฅ

[์„œ๋น„์Šค ์‹œ์—ฐ ์˜์ƒ]
https://youtu.be/5_XBmdblgHk

๐Ÿ“€ AI๋กœ ์ œ์ž‘ํ•œ ๊ด‘๊ณ ์˜์ƒ

๊ฝƒ์ง‘
https://storage.googleapis.com/hackathon_hmh/Four_Seasons%20_video.mp4

์‹๋‹น
https://storage.googleapis.com/hackathon_hmh/template2Video.mp4

์นดํŽ˜
https://storage.googleapis.com/hackathon_hmh/sandwichTemplate.mp4


๐Ÿงฉ Challenges & Solutions

1. ์†Œ์žฌ ๊ฐ€์ด๋“œ ๋ฐ ์—…์ข… ์ œ์•ฝ์‚ฌํ•ญ ๊ฒ€์ฆ์˜ ๋ณต์žก์„ฑ

Problem
๊ด‘๊ณ  ์†Œ์žฌ ๊ฐ€์ด๋“œ๋ผ์ธ๊ณผ ์—…์ข…๋ณ„ ์ œ์•ฝ์‚ฌํ•ญ์ด PDF ๋ฌธ์„œ ํ˜•ํƒœ๋กœ๋งŒ ์ œ๊ณต๋˜์–ด
์†Œ์ƒ๊ณต์ธ์ด ์ง์ ‘ ์ดํ•ดํ•˜๊ณ  ๊ฒ€์ฆํ•˜๊ธฐ์— ์ง„์ž… ์žฅ๋ฒฝ์ด ๋†’์•˜์Šต๋‹ˆ๋‹ค.

Solution

  • FFmpeg๋ฅผ ํ™œ์šฉํ•ด ๊ด‘๊ณ  ์˜์ƒ์˜ ๊ทœ๊ฒฉ, ํ•ด์ƒ๋„, ์šฉ๋Ÿ‰์„ ์ž๋™ ๊ฒ€์ฆ
  • Google Cloud Video Intelligence๋ฅผ ํ†ตํ•ด
    • ๊ฐ์ฒด ์ธ์‹
    • ํ…์ŠคํŠธ ์ถ”์ถœ(OCR)
    • ์œ ํ•ด์„ฑ ๋ฐ ๋ถ€์ ํ•ฉ ์š”์†Œ ๊ฒ€์‚ฌ
      โ†’ ๊ด‘๊ณ  ์ง‘ํ–‰ ์ „ ๋‹จ๊ณ„์—์„œ ์†Œ์žฌ ์ ํ•ฉ์„ฑ์„ ์ž๋™์œผ๋กœ ์‚ฌ์ „ ๊ฒ€์ฆํ•˜๋„๋ก ๊ฐœ์„ ํ–ˆ์Šต๋‹ˆ๋‹ค.

2. ์˜์ƒ ์ƒ์„ฑ AI์˜ ํ•œ๊ณ„ (ํ€„๋ฆฌํ‹ฐ ยท ๋น„์šฉ ยท ์–ธ์–ด ์ธ์‹)

Problem
๊ธฐ์กด ์˜์ƒ ์ƒ์„ฑ AI๋Š”

  • ๋‚ฎ์€ ๊ฒฐ๊ณผ ํ€„๋ฆฌํ‹ฐ
  • ๋†’์€ ๋น„์šฉ
  • ํ•œ๊ตญ์–ด ๋ฌธ๊ตฌ๋ฅผ ์™ธ๊ตญ์–ด๋กœ ์˜ค์ธ์‹ํ•˜๋Š” ๋ฌธ์ œ๊ฐ€ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค.

Solution

  • ๋ฌธ๊ตฌ๋ฅผ ์ œ์™ธํ•œ ๋‹จ์ผ ์ด๋ฏธ์ง€ ๊ธฐ๋ฐ˜ ์˜์ƒ ์ƒ์„ฑ
  • ์ƒ์„ฑ๋œ ์˜์ƒ์— ๋Œ€ํ•ด ์„œ๋ฒ„ ๋‹จ์—์„œ ๋ฌธ๊ตฌยทํŽธ์ง‘์„ ํ›„์ฒ˜๋ฆฌ
    โ†’ ์˜์ƒ ํ€„๋ฆฌํ‹ฐ๋ฅผ ์•ˆ์ •ํ™”ํ•˜๋ฉด์„œ ๋น„์šฉ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ–ˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ› ๏ธ Tech Stack Summary

  • React
  • TypeScript
  • Next.js
  • Tailwind CSS
  • Zustand
  • React Query
  • FFmpeg
  • Google Cloud Video Intelligence

๐Ÿ“š Related Articles

๐Ÿ”— ์‹ ํ•œ ์Šคํ€˜์–ด ๋ธŒ๋ฆฟ์ง€ ํ•ด์ปคํ†ค ํ›„๊ธฐ


๐Ÿ”— ์›น์—์„œ ์˜์ƒ ํŽธ์ง‘ ํ•ด๋ณด๊ธฐ (FFmpeg)


๐Ÿ”— ๊ฐœ๋ฐœ์„ ํ•˜๊ธฐ ์œ„ํ•ด ๋ฌธ์ œ๋ฅผ ํ‘ผ๋‹ค?

Releases

Packages

Contributors

Languages