Skip to content

Commit

Permalink
Update document:
Browse files Browse the repository at this point in the history
Update the introduction contents of the embedded software contests
http://clm.lge.com/issue/browse/SWDD-229601
  • Loading branch information
mibu82 committed Jan 25, 2024
1 parent e406953 commit f99dbb1
Show file tree
Hide file tree
Showing 12 changed files with 165 additions and 0 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
---
title: Embedded SW Contest 2023 - Grand Prize
display_title: The World Embedded Software Contest 2023 - VOIDMIAN
date: 2024-01-17
slug: embedded-sw-contest-2023-voidmian
posttype: article
toc: true
thumbnail: th-eswc-2023-voidmian.png
---

## Introduction

The grand prize of the 21st World Embedded Software Competition goes to SOFI of team VOIDMIAN! SOFI stands for sound of food information and is a voice-enabled food information system for those who are visually impaired or with low vision. With the food classification and use-by date detection device, SOFI helps users with visual impairment or low vision, due to age, LASEK, etc., select food and prevents them from consuming unhealthy food. Team VOIDMIAN analyzed the space of the refrigerator's home bar from a fresh point of view and added a rotating food scanning function to the door of the home bar, and also they implemented a voice-enabled food information system based on webOS Open Source Edition (OSE).

Let's see a demo video of the project (Korean only).

{{< youtube GVSaJLW1eDQ >}}

{{< note >}}
If you are also curious about the previous winner of the contest, see [The World Embedded Software Contest 2022]({{< relref "2022-12-29-embedded-sw-contest-2022" >}}).
{{< /note >}}

## System Architecture

The following description shows the overall system architecture.

| Component | Type | Description |
|-----------|-------------|-------------|
| Image Scanner on the Magic space <br>(DC Motor / ESP32-CAM w/ Arduino) | Hardware | <ul><li>Scan product images to get barcodes, use-by dates, allergy information, etc. (ESP32-CAM)</li><li>Control the rotation of the product using the installed DC motor (Servo Motor)</li></ul> |
| Flask Server | Software | <ul><li>Extract and save user information and scanned product data in the JSON format and return data upon client requests</li></ul> |
| Client (Application) | Software | <ul><li>Web App (webOS)<ul><li>To manage (register, delete, etc.) and inquire on user and product information</li><li>Functions: View the scan history / Register product and user information / Connect to websites that provide cooking recipes / Guide how to use SOFI</li></ul></li><li>Mobile App (Android)<ul><li>To inquire on registered users and product information</li><li>Functions: View today's scanned products / View the whole list of scanned products/ View the user list</li></ul></li></ul> |

### Hardware (Image Scanner on the Magic-space)

The following figure describes how the hardware, including the Magic-space on the refrigerator, works to scan product images.

{{< figure src="/images/blog/articles/eswc-2023-system-architecture-hardwear-voidmian.png" alt="The overall system architecture(hardware) of the project of the Voidmian team" >}}

### Software

The following diagram describes the system composed of a webOS-based web app and a FLASK server to store and manage product image data.

{{< figure src="/images/blog/articles/eswc-2023-system-architecture-software-voidmian.png" alt="The overall system architecture(software) of the project of the Voidmian team" >}}


## Features

The key features of the project are as follows:

### Voice command recognition

- Users can scan, register, and inquire on products using voice.
- Provides voice-enabled UI so that those who are visually impaired or with low vision can use all the functions with voice commands
- Buttons are also available if voice commands are not needed.

### Product image scanning and data storage

- Scans and registers barcodes, use-by dates, and allergy information of products using ESP32-CAM
- Stores product information in JSON files for ease of management and platform independence of data
- Secures accuracy of product information by scanning multiple images
- Ensures accuracy in barcode recognition using the product barcode image recognition library (via Pyzbar)

### Data management and inquiry

- Users can inquire on the registered product and user information via web app (webOS) and mobile app (Android)
- Outputs product and user information, which is originally text based, with voice using TTS
- Helps determine whether to purchase products by analyzing the product information (allergies, use-by date, etc.)


{{< figure src="/images/blog/articles/eswc-2023-sequence-diagram-scan-voidmian.png" caption="" alt="the sequence diagram that describes the process of the image scanning" >}}

## Winner's Interview

The SOFI was proudly awarded the grand prize recognized as an excellent example of how webOS can be used to help the visually impaired and others with low vision.

Here's what the VOIDMIAN team members feel about the whole experience in the competition.

> It wasn't a difficult choice that we picked webOS when applying for the competition. We knew it is a stable operating system that had already been adapted to LG smart TVs and thought it would be a good fit for our project.
>
> However, despite the wide knowledge about Linux and Windows that our team has, we had to go through many difficulties as novice developers of webOS. We had to start from understanding how webOS works. While working on the project, the webOS OSE developer website helped us a lot as it provides detailed guides on how to implement web apps, use the LS2 API, and so on. Thanks to those guides, we could resolve problems one by one during the development.
## Resources

- Source code: [GitHub](https://github.com/dbrjsdn1220/webOS_Contest_2023_SOFI) (Korean only)
- Video demo: [YouTube](https://www.youtube.com/watch?v=GVSaJLW1eDQ) (Korean only)
Original file line number Diff line number Diff line change
@@ -0,0 +1,80 @@
---
title: Embedded SW Contest 2023 - webOS Winner
display_title: The World Embedded Software Contest 2023 - Web Oh Yes
date: 2024-01-24
slug: embedded-sw-contest-2023-webohyes
posttype: article
toc: true
thumbnail: th-eswc-2023-webohyes.png
---

## Introduction

The winner in the webOS sector of the 21st World Embedded Software Contest was team Web Oh Yes who developed the Housespital (House + Hospital) service. The Housepital service is a personalized medical service that can upgrade each individual's personal health management.

With a growing number of single-person households in all age groups, the need for lifestyle-customized healthcare services is also increasing. Older people need those services as their nutrition intake and activities decrease, and young people need them because they are too busy working to care for their health. To adress this problem, the team designed a telemedicine service, a.k.a. Housepital service, for the medically vulnerable. In order to overcome the time and physical limitations to visit a hospital, they developed a real-time remote medical treatment system using webRTC and further advanced it to an all-in-one healthcare service where all related players - patients, doctors, pharmacists, and emergency rescue situation rooms - are brought together. This Housepital service aims at building a 24-7 remote medical checkup system for the medically vulnerable by sharing neceessary data, such as medication and healthcare records, with hostipals and ultimately providing a customized comprehensive healthcare service.

Let's see a demo video of the project (Korean only).

{{< youtube SRm__HseULQ >}}

{{< note >}}
If you are also curious about the previous winner of the contest, see [The World Embedded Software Contest 2022]({{< relref "2022-12-29-embedded-sw-contest-2022" >}}).
{{< /note >}}

## System Architecture

The following description shows the overall system architecture.

{{< figure src="/images/blog/articles/eswc-2023-system-architecture-webohyes.png" alt="The overall system architecture of the project" >}}

| Component | Description |
|-----------|-------------|
| Housepital Application | <ul><li>Web app developed using Enact.js and React that enables seamless collaboration among patients, hospitals, doctors, and emergency rescue situation rooms</li><li>Easy to sign up using social login, such as Naver and Kakao</li><li>Provides real-time peer-to-peer (P2P) chat using WebRTC</li></ul> |
| Healthcare Server | <ul><li>Server that manages data from sensors and processes and transmits data for the Housepital app.</li><li>Handles events for user-device calls using bidirectional [socket.io](https://socket.io/) communication</li><li>Saves and searches for data in the database and determines if there is any possible side effect of medication to the user using the Dialogflow chatbot</li></ul> |
| Healthcare Sensor: IoT Devices | <ul><li>Auxiliary device that measures the body temperature and heart rate and transmits the data to the server</li><li>Manages data delivered from external sensors through I2C communication with submodules connected to the Arduino board</li></ul> |

## Features

The key features of the project are as follows:

{{< figure src="/images/blog/articles/eswc-2023-feature-structure-webohyes.png" alt="The overall flow diagram of the project" >}}

### Medical Appointment

{{< figure src="/images/blog/articles/eswc-2023-feature-medical-appointment-webohyes.png" caption="" alt="the feature of the medical-appointment system" >}}

- Enables users to make an appointment with one of the registered medicall staff and receive face-to-face or remote video medical treatment using the Housepital app
- Shares medication and health information of users for personalized medical services
- As an all-in-one medical service from medical treatment to pharmacy reservation, it improves patient convenience.

### Madication Management

{{< figure src="/images/blog/articles/eswc-2023-feature-medication-webohyes.png" caption="" alt="the flowchart of the medication-management system" >}}

- Detects drugs that possibly cause side effects
- Sets off an alarm for medication inatke to help users not forget
- Provides a medication planner (calendar) to check medication history

### Health Management

{{< figure src="/images/blog/articles/eswc-2023-feature-healthcare-webohyes.png" caption="" alt="the structure of the health-management system via IoT devices" >}}

- Measures the health condition, such as blood pressure and body temperature, accurately using IoT devices
- Provides an emergency call button to make a call to the designated location easily in case of an emergent health problem
- Provides highly readable health data on graphs

## Winner's Interview

The Housepital service was a good and opportune use case of webOS that builds an efficient medical examination and treatment system for both face-to-face and remote cases in an era where the number of single-person households is increasing.

Let's listen to what the Web Oh Yes team members want to talk about the experience in the competition and the award.

> When we first experienced webOS to compete in the webOS sector, we became fascinated by its expressive power, and while developing web apps and services using LS2API on the platform, we also found out that its development environment is very efficient.
>
> Sometimes we ran into problems in setting and configuring the development environment in the process, but thanks to the kind and active support from the mentor in LG Electronics, we were able to fix them. We would like to take this opportunity to express our gratitude to the mentor. Although the competition is over, we are planning to organize a circle or study group to continue studying webOS and searching for ways to make use of it.
## Resources

- Source code: [GitHub](https://github.com/hwna00/2023ESWContest_webOS_3015) (Korean only)
- Video demo: [YouTube](https://www.youtube.com/watch?v=SRm__HseULQ) (Korean only)
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit f99dbb1

Please sign in to comment.