This is a project that participated in the 2024 Google Solution Challenge.
The team name that developed the Bridge project is Pillar.
| Gyeongrok Kim | Dawon Seo | Mirae Kim | Daehyeon Choe |
|---|---|---|---|
 @gomsang |
 @Dawon00 |
 @FutureandKim |
 @dablro12 |
| Lead Frontend |
Frontend | Backend | AI |
'Bridge' is an AI assistant solution designed to help individuals with language disabilities overcome communication barriers in medical and everyday situations.
It integrates advanced natural language processing algorithms and AI to accurately interpret user intentions and generate appropriate responses.
This reduces medical diagnostic errors, improves the quality of life for people with language development disorders, and facilitates education and social participation.
'Bridge' combines real-time speech recognition and location-based services to enable real-time translation and voice conversion into various languages, supporting effective communication in daily life for individuals with language disabilities.
- Dart SDK: 3.2.6
- Flutter SDK: Compatible with version >=3.2.6 <4.0.0
- geolocator: 11.0.0
- just_audio: 0.9.36
- record: 5.0.4
- speech_to_text: 6.6.0
lib
┣ api
┃ ┣ responses
┃ ┃ ┣ api_response.dart
┃ ┃ ┣ res_replies.dart
┃ ┃ ┣ res_dialogue.dart
┃ ┃ ┣ res_message_dialogue.dart
┃ ┃ ┣ res_modification_options.dart
┃ ┃ ┗ res_place_recommendation.dart
┃ ┗ api_client.dart
┣ controllers
┃ ┗ voice_recorder.dart
┣ models
┣ ui
┃ ┣ constants
┃ ┃ ┗ app_theme.dart
┃ ┣ screens
┃ ┃ ┣ TestScreen.dart
┃ ┃ ┣ common_widget_test_screen.dart
┃ ┃ ┣ full_text_screen.dart
┃ ┃ ┣ select_answer_screen.dart
┃ ┃ ┣ select_place_screen.dart
┃ ┃ ┣ stt_test_screen.dart
┃ ┃ ┣ voice_recognition_screen.dart
┃ ┃ ┗ voice_setting_screen.dart
┃ ┗ widgets
┃ ┃ ┣ buttons
┃ ┃ ┃ ┣ button_basic.dart
┃ ┃ ┃ ┣ button_basic_icon.dart
┃ ┃ ┃ ┣ button_current_situation.dart
┃ ┃ ┃ ┣ button_select_sentence.dart
┃ ┃ ┃ ┣ button_suggestion_sentence.dart
┃ ┃ ┃ ┣ button_toggle_icon.dart
┃ ┃ ┃ ┣ button_toggle_text.dart
┃ ┃ ┃ ┗ button_word_replacement.dart
┃ ┃ ┣ progresses
┃ ┃ ┃ ┗ progress_threedots.dart
┃ ┃ ┗ change_word.dart
┣ utils
┃ ┗ token_manager.dart
┗ main.dart
- Java: 17
- Spring Boot: 3.2.2
- Spring Data JPA
- MySQL
- Docker
- AWS EC2
- Google Map Platform: place API
src
┣━ main
┃ ┣━ java
┃ ┃ ┗━ com
┃ ┃ ┗━ pillar
┃ ┃ ┗━ bridge
┃ ┃ ┣━ BridgeApplication.java
┃ ┃ ┣━ apiUtils
┃ ┃ ┃ ┣━ ErrorAdvice.java
┃ ┃ ┃ ┣━ ResponseDto.java
┃ ┃ ┃ ┣━ ResponseUtil.java
┃ ┃ ┃ ┗━ codeStatus
┃ ┃ ┃ ┣━ ErrorResponse.java
┃ ┃ ┃ ┗━ SuccessResponse.java
┃ ┃ ┣━ config
┃ ┃ ┃ ┣━ AppConfig.java
┃ ┃ ┃ ┗━ Constants.java
┃ ┃ ┣━ controller
┃ ┃ ┃ ┣━ AlterController.java
┃ ┃ ┃ ┣━ DialogueController.java
┃ ┃ ┃ ┣━ FullDialogueController.java
┃ ┃ ┃ ┣━ PlacesController.java
┃ ┃ ┃ ┣━ ReplyController.java
┃ ┃ ┃ ┣━ TTSController.java
┃ ┃ ┃ ┗━ UpdateMessageController.java
┃ ┃ ┣━ dto
┃ ┃ ┃ ┣━ FullDialogue
┃ ┃ ┃ ┃ ┣━ FullDialogueDto.java
┃ ┃ ┃ ┃ ┗━ FullDialogueResponseDto.java
┃ ┃ ┃ ┣━ PlacesDto.java
┃ ┃ ┃ ┣━ RegisterResponse.java
┃ ┃ ┃ ┣━ RequestModel.java
┃ ┃ ┃ ┣━ TTS
┃ ┃ ┃ ┃ ┣━ TTSRequest.java
┃ ┃ ┃ ┃ ┗━ TTSResponse.java
┃ ┃ ┃ ┣━ TTSDto.java
┃ ┃ ┃ ┣━ UpdateMessage
┃ ┃ ┃ ┃ ┣━ UpdateRequest.java
┃ ┃ ┃ ┃ ┗━ UpdateResponse.java
┃ ┃ ┃ ┣━ alter
┃ ┃ ┃ ┃ ┣━ AlterRequest.java
┃ ┃ ┃ ┃ ┣━ AlterResponse.java
┃ ┃ ┃ ┃ ┗━ WordOption.java
┃ ┃ ┃ ┣━ dialogue
┃ ┃ ┃ ┃ ┣━ DialogueRequest.java
┃ ┃ ┃ ┃ ┗━ DialogueResponse.java
┃ ┃ ┃ ┗━ place
┃ ┃ ┃ ┣━ googleApi
┃ ┃ ┃ ┃ ┣━ GoogleResponse.java
┃ ┃ ┃ ┃ ┣━ PlaceResponse.java
┃ ┃ ┃ ┃ ┗━ PlacesRequest.java
┃ ┃ ┃ ┗━ kakaoApi
┃ ┃ ┃ ┣━ Document.java
┃ ┃ ┃ ┣━ KaKaoResponse.java
┃ ┃ ┃ ┣━ Meta.java
┃ ┃ ┃ ┣━ PlaceNameResponse.java
┃ ┃ ┃ ┗━ SameName.java
┃ ┃ ┣━ entitiy
┃ ┃ ┃ ┣━ Device.java
┃ ┃ ┃ ┣━ Dialogue.java
┃ ┃ ┃ ┗━ Messages.java
┃ ┃ ┣━ repository
┃ ┃ ┃ ┣━ DeviceRepository.java
┃ ┃ ┃ ┣━ DialogueRepository.java
┃ ┃ ┃ ┗━ MessageRepository.java
┃ ┃ ┗━ service
┃ ┃ ┣━ AlterService.java
┃ ┃ ┣━ DeviceService.java
┃ ┃ ┣━ DialogueService.java
┃ ┃ ┣━ FullDialogueService.java
┃ ┃ ┣━ ReplyService.java
┃ ┃ ┣━ TTSService.java
┃ ┃ ┣━ UpdateMessageService.java
┃ ┃ ┗━ place
┃ ┃ ┣━ RecommPlaceGoogleService.java
┃ ┃ ┗━ RecommPlaceKaKAoService.java
┃ ┗━ resources
┗━ test
┗━ java
┗━ com
┗━ pillar
┗━ bridge
┗━ BridgeApplicationTests.java
- Language : Python 3.8
- Reccomendation LLM : Google Cloud Gemini Pro
- Text-To-Speech : Google Cloud TTS
- Natural Langauge Processing : NLTK
- Pytorch
- 134" Language Translation : Google Cloud Translation
- Audio Processing for Custom TTS : Torrtoise-TTS(Update Coming Soon!)
Bridge_AI
┣━ app
┃ ┣━ __init__.py
┃ ┣━ main.py
┃ ┣━ requirements.txt
┃ ┗━ routers
┃ ┣━ __init__.py
┃ ┣━ alternative_word.py
┃ ┣━ recomm_msg.py
┃ ┣━ stt.py
┃ ┗━ tts.py
┣━ recomm
┃ ┣━ __init__.py
┃ ┣━ input
┃ ┃ ┗━ testInput.json
┃ ┣━ prompt.txt
┃ ┣━ prompt_2.txt
┃ ┣━ result
┃ ┃ ┗━ output.json
┃ ┣━ run.py
┃ ┣━ script_2.py
┃ ┣━ synonyms.ipynb
┃ ┗━ utils
┃ ┣━ multi_turn_1.py
┃ ┣━ multi_turn_2.py
┃ ┣━ script.py
┃ ┣━ single_turn.py
┃ ┗━ tutorial.ipynb
┣━ requirements.txt
┗━ tts
┣━ __init__.py
┣━ gtts.py
┣━ input
┣━ result
┣━ run.py
┗━ tutorial.ipynb