motion-base
is a web application that aims to provide a unified entry point for accessing and processing ground motion
records from different national databases.
It comes with a web interface and a Python client that can be used to access the data programmatically.
Check out the demo site.
- Parse and index ground motion records from different databases in a uniform format.
- Search and select ground motion records based on different criteria, including magnitude, PGA, event time, event location, etc.
- Provide ad hoc processing, including up-/down-sampling, normalization, filtering and computation of response spectra.
- Converting acceleration record to velocity/displacement record that is consistent with specific time integration methods.
# 1. clone the project
git clone https://github.com/TLCFEM/motion-base.git
cd motion-base
# 2. create a virtual environment and install python dependencies
python -m venv .venv
source .venv/bin/activate
pip install -e .[dev,client]
# 3. install node.js dependencies
cd gui
pnpm install
cd ..
There are no extra steps needed to set up the development environment. To run the application locally, use the following command:
# 1. mongodb and rabbitmq
docker compose -f docker/docker-compose.yml up -d
# 2. backend
python ./mb_runner.py
# 3. celery workers
python ./mb_runner.py celery
# 4. frontend
cd gui
pnpm dev
Use back.Dockerfile
and front.Dockerfile
to build the docker images for the backend and frontend, respectively.
To host the application, two files are needed: .env
and docker-compose-production.yml
.
mkdir motion-base && cd motion-base
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/.env
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/docker-compose-production.yml
# edit the .env file to set the correct values
# or create those environment variables in other means
docker compose -f docker-compose-production.yml up -d
It shall run out of the box, but it is recommended to check the settings and adjust accordingly.
It is recommended to use one process per container and scale the application horizontally.
To do so, one can check the example given in file docker/docker-compose-production-nginx.yaml
.
To use it, docker/nginx.conf.sh
should also be available.
mkdir motion-base && cd motion-base
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/.env
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/nginx.conf.sh
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/docker-compose-production-nginx.yml
docker compose -f docker-compose-production-nginx.yml up -d
Please feel free to use other tools to deploy the application, such as Kubernetes, Docker Swarm, etc.
# 1. clone the project
git clone https://github.com/TLCFEM/motion-base.git
cd motion-base
# 2. create a virtual environment and install python dependencies
python -m venv .venv
source .venv/bin/activate
pip install .[client]
It is then possible to use the client to access the data.
import anyio
from mb.client import MBClient
api_url = "http://somewhere.the.application.is.hosted"
async def search():
async with MBClient(api_url) as client:
results = await client.search({"min_magnitude": 6.0, "min_pga": 200.0})
for r in results:
print(r)
if __name__ == "__main__":
anyio.run(search)
The raw data, once downloaded from sources, can be uploaded to the application.
import anyio
from mb.client import MBClient
# assuming the application is running locally
api_url = "http://localhost:8000"
# using the default credentials
username = "test"
password = "password"
region = "jp"
# assume current folder contains the files to be uploaded
async def upload():
async with MBClient(api_url, username, password) as client:
await client.upload(region, '.')
if __name__ == "__main__":
anyio.run(upload)
The raw data is available
at Strong Motion Seismograph Networks.
The waveform files in ASCII format *.EW
, *.NS
, and *.UD
can be uploaded and parsed.
The raw data is available at Strong Motion Data Products.
The waveform files *.V1A
and *.V2A
can be uploaded and parsed.