Synthesis Image Noise Detection on Distributed Data : A web app to collect data on noise detection by humans on images. https://diran.univ-littoral.fr/doc

Jérôme BUISINE 6561a67ebd Merge branch 'release/v0.6.4' into master il y a 3 ans
DOCUMENTATION ef80359084 Changed project name + added package metadata il y a 4 ans
public e5f36a23ab Fixed pagetitle il y a 4 ans
server 03cd473729 add of newsletter component; use message and add user help il y a 3 ans
src 5c542ad93d Add of probs to redirect user if new scenes available (balacing improvment) il y a 3 ans
test 4f430af6b6 fix another unit test.. il y a 4 ans
utils e322fe7a06 update selected scene for SIN3D il y a 3 ans
.dockerignore 88b91170a2 Added apiDoc documentation il y a 4 ans
.editorconfig 6c62d244ef init il y a 5 ans
.eslintrc.js 94610236d9 Collect more data, added DataCollect route doc il y a 4 ans
.gitignore 5c542ad93d Add of probs to redirect user if new scenes available (balacing improvment) il y a 3 ans
LICENSE 90a7f736ab Added readme and mit license il y a 5 ans
README.md 1c4b135aef Update of documentation il y a 4 ans
babel.config.js 6c62d244ef init il y a 5 ans
back.Dockerfile 1e27d8d6cc update db connection for cron task il y a 3 ans
cleanExtracts.js 3dc13239fa Added experiment "AreSameImagesReferenceOneExtract" il y a 4 ans
config.js 5c542ad93d Add of probs to redirect user if new scenes available (balacing improvment) il y a 3 ans
config.messagesId.js 03cd473729 add of newsletter component; use message and add user help il y a 3 ans
docker-compose.frontapp_only.yml 72cd80e1e6 Release hotfix il y a 5 ans
docker-compose.yml 81025772b1 update dockerfile for back instance il y a 3 ans
expeStats.js 1e27d8d6cc update db connection for cron task il y a 3 ans
experimentConfig.default.js 2679a69543 update selected scene for SIN3D il y a 3 ans
front.Dockerfile 72cd80e1e6 Release hotfix il y a 5 ans
generateExtracts.js 5ceb9716e3 update scenes list if new scenes are available il y a 3 ans
index.js 5c542ad93d Add of probs to redirect user if new scenes available (balacing improvment) il y a 3 ans
jsconfig.json 2991ca6cf9 Better config system with automatic loading. Refactored file structure il y a 4 ans
package.json 4188287672 Add of filter into scenes list il y a 4 ans
webhook_deploy_gogs.js 69e8a47a76 Fixed webhook script and docker port il y a 4 ans
yarn.lock 03cd473729 add of newsletter component; use message and add user help il y a 3 ans

README.md

SIN3D

Synthesis Image Noise Detection on Distributed Data (SIN3D)

A web app to collect data on noise detection by humans on images.

Download project

git clone https://gogs.univ-littoral.fr/Prise3D/SIN3D.git
cd SIN3D

Application

See https://diran.univ-littoral.fr

Developer documentation

See /DOCUMENTATION

API documentation

See https://diran.univ-littoral.fr/doc

Data extraction

You can use the SIN3D-data-extract library to easily extract data from this application database.

Run as a Docker instance

Configure application

Use the following environment variables to configure the application.

Option Default value Description Server Client
PORT 5000 The port used by the started application
SERVE_CLIENT true Should the server serve client (Fully local application) ⬜️
IMAGES_PATH ./images The directory where the images are stored (absolute path if changed ⚠️) ⬜️
MONGO_URI mongodb://localhost/sin3d MongoDB database connection URI ⬜️

Configure more deeply the way the app works by modifying config.js.

Option Default value Description
apiPrefix /api The url prefix for the API
imageServedUrl /api/images The url prefix from where the images are served
serverPort 5000 The port used by the server
mongoDatabaseURI mongodb://localhost/sin3d MongoDB database connection URI
imagesPath ./images The directory where the images are stored
serveClient true Should the server serve client files from the /dist directory
fileNameConvention /^(.*)?_([0-9]{2,})\.(.*)$/ File name convention for images
extractsDirName extracts Name of the directory containing extracts
sceneFileNameBlackList ['config', 'seuilExpe', 'extracts'] Files to ignore in scenes
deleteExtractsCronTime 0 3 * * * (every day at 03:00 AM) Cron time for extracts deletion
logger Logs : logs/server.combined.log Errors : logs/server.error.log Default application logger
dbLogger Logs : logs/db.log Errors : logs/db.error.log Database logger configuration

Run server + client

Linux

PORT=8080 SERVE_CLIENT=true IMAGE_PATH=/var/images docker-compose up

Windows

SET PORT=8080
SET SERVE_CLIENT=true
SET IMAGE_PATH=C:\my\images
docker-compose up

Run server only

Linux

SERVE_CLIENT=false docker-compose up

Windows

SET SERVE_CLIENT=false
docker-compose up

Run client only

docker-compose -f docker-compose.frontapp_only.yml up

Notice

New version Docker build

When using a new version of the project, you need to re-build the application with Docker.

# Server / Server + client versions
docker-compose build

# Client only version
docker-compose -f docker-compose.frontapp_only.yml build

Docker instance on a Windows host

As of now, Windows hosts are not supported due to MongoDB volumes not being mappable to this system.

Run on the file system

Project setup

Install project's dependencies.

yarn install

If this is a production build, set the NODE_ENV environment variable to production to enhance performance.

Linux

export NODE_ENV=production

Windows

SET NODE_ENV=production

API

Run the server

yarn run server:start

If you specifically want to not start the extracts remover service (extracts are automatically deleted everyday), use the following.

server:start:no-delete-extracts

Automatically fix the API code syntax with ESLint

yarn run server:lint

Client

To use the client, you need to initialize experiment configurations first.

cp -r experimentConfig.default experimentConfig

You can modify the configuration for each mixins, experiments or scene by modifying files in the newly created ./experimentConfig directory.

Compile and minify for production

Files will be built to the dist/ directory.

yarn run app:build

Run a hot-reload server for client development

yarn run app:dev

Automatically fix the client code syntax with ESLint

yarn run app:lint

Automated deployment

The app can be automatically deployed when a push event is sent to the master branch using Gogs. Open a port to the web and start webhook_deploy_gogs.js.

WEBHOOK_SECRET=your_webhook_secret WEBHOOK_PORT=5000 SERVE_CLIENT=true PORT=8080 node webhook_deploy_gogs.js

You can pass any parameters to the script, they will be passed to the Docker instance. The following are required.

Option Description
WEBHOOK_SECRET The secret set on Gogs to verify the identity
WEBHOOK_PORT The port the script is listening to

Running tests

The docker-compose script will automatically run tests. Use the following command to run them by hand.

yarn test

Generate API documentation

The docker-compose script will automatically build the API documentation. Use the following command to build it by hand.

yarn doc

The documentation is generated to the doc/ directory. If you started the server, the documentation is served at /doc/.

Collected DATA

During application use a lot of data is collected by platform, here a description of main message identifier used:

  • COLLECT_DATA: specify that the collected data process began.
  • EXPERIMENT_STARTED: message which is used for start of an experiment.
  • EXPERIMENT_DATA: message for data of an experiment.
  • EXPERIMENT_VALIDATED: end of experiences message.

License

The MIT license