Sign In

CycleBEV: Regularizing View Transformation Networks via View Cycle Consistency for Bird's-Eye-View Semantic Segmentation

Created by
  • Haebom
Category
Empty

μ €μž

Jeongbin Hong, Dooseop Choi, Taeg-Hyun An, Kyounghwan An, Kyoung-Wook Min

πŸ’‘ κ°œμš”

λ³Έ 논문은 자율 μ£Όν–‰μ—μ„œ λ°œμƒν•˜λŠ” 원근 μ‹œμ (PV)μ—μ„œ 쑰감도(BEV)둜의 νŠΉμ§• λ³€ν™˜ μ‹œ κ²ͺλŠ” 깊이 λΆˆν™•μ‹€μ„± 및 가렀짐 문제λ₯Ό ν•΄κ²°ν•˜κΈ° μœ„ν•΄ 'CycleBEV'λΌλŠ” μƒˆλ‘œμš΄ μ •κ·œν™” ν”„λ ˆμž„μ›Œν¬λ₯Ό μ œμ•ˆν•©λ‹ˆλ‹€. μ΄λŠ” 쑰감도 μ„Έκ·Έλ©˜ν…Œμ΄μ…˜ 맡을 λ‹€μ‹œ 원근 μ‹œμ μœΌλ‘œ λ§€ν•‘ν•˜λŠ” μ—­λ³€ν™˜(IVT) λ„€νŠΈμ›Œν¬λ₯Ό ν™œμš©ν•˜μ—¬, ν›ˆλ ¨ κ³Όμ •μ—μ„œ λ³€ν™˜ λ„€νŠΈμ›Œν¬λ₯Ό μ •κ·œν™”ν•¨μœΌλ‘œμ¨ 더 ν’λΆ€ν•œ 의미둠적 및 κΈ°ν•˜ν•™μ  정보λ₯Ό ν•™μŠ΅ν•˜λ„λ‘ λ•μŠ΅λ‹ˆλ‹€. μ œμ•ˆλœ 방법은 κΈ°μ‘΄ λ³€ν™˜ λ„€νŠΈμ›Œν¬μ˜ μ„±λŠ₯을 ν–₯μƒμ‹œν‚€λ©΄μ„œ μΆ”λ‘  λ³΅μž‘μ„±μ„ μ¦κ°€μ‹œν‚€μ§€ μ•ŠμŠ΅λ‹ˆλ‹€.

πŸ”‘ μ‹œμ‚¬μ  및 ν•œκ³„

β€’
쑰감도(BEV) μ„Έκ·Έλ©˜ν…Œμ΄μ…˜ μ„±λŠ₯ ν–₯상을 μœ„ν•΄ μ—­λ³€ν™˜(IVT) λ„€νŠΈμ›Œν¬λ₯Ό ν™œμš©ν•œ μ£ΌκΈ° 일관성(cycle consistency) 기반 μ •κ·œν™”μ˜ νš¨κ³Όμ„±μ„ μž…μ¦ν–ˆμŠ΅λ‹ˆλ‹€.
β€’
μ œμ•ˆλœ CycleBEVλŠ” κΈ°ν•˜ν•™μ  및 ν‘œν˜„ κ³΅κ°„μœΌλ‘œ μ£ΌκΈ° 일관성을 ν™•μž₯ν•˜μ—¬ μ—­λ³€ν™˜ λ„€νŠΈμ›Œν¬μ˜ ν™œμš©λ„λ₯Ό λ†’μ˜€μŠ΅λ‹ˆλ‹€.
β€’
ν›ˆλ ¨ μ‹œμ—λ§Œ ν™œμš©λ˜λŠ” μ—­λ³€ν™˜ λ„€νŠΈμ›Œν¬ 덕뢄에 μΆ”λ‘  μ‹œκ°„ λ³΅μž‘μ„±μ„ μ¦κ°€μ‹œν‚€μ§€ μ•ŠμœΌλ©΄μ„œλ„ μ„±λŠ₯ ν–₯상을 λ‹¬μ„±ν–ˆμŠ΅λ‹ˆλ‹€.
β€’
μ œμ•ˆλœ λ°©λ²•λ‘ μ˜ μ„±λŠ₯은 λ‹€μ–‘ν•œ λ³€ν™˜ λ„€νŠΈμ›Œν¬ λͺ¨λΈκ³Ό λ°μ΄ν„°μ…‹μ—μ„œ μΌκ΄€λœ κ°œμ„ μ„ λ³΄μ˜€μŠ΅λ‹ˆλ‹€.
β€’
ν–₯ν›„ μ—°κ΅¬μ—μ„œλŠ” λ‹€μ–‘ν•œ μ’…λ₯˜μ˜ λ·° λ³€ν™˜ λ„€νŠΈμ›Œν¬ 및 λ³΅μž‘ν•œ λ„λ‘œ ν™˜κ²½μ—μ„œ CycleBEV의 적용 κ°€λŠ₯성을 λ”μš± 탐색할 ν•„μš”κ°€ μžˆμŠ΅λ‹ˆλ‹€.
πŸ‘