Giter Club home page Giter Club logo

pricescrawler_content-base's Introduction

Prices Crawler - Content Base

๐Ÿ’ป Description

The main goal of this project is to provide a framework to search, store and retrieve product data, enabling price comparison and analysis.

Open API URL: http://localhost:8080/swagger-ui.html

๐Ÿ“ Requirements

# name Value
1 Java 17
2 Maven 3.8.6

โš ๏ธ Known Issues

  • There is a known issue with the DATABASE_NAME environment variable not functioning properly after the Spring Boot 3.1 update.
    • Solution: To resolve this issue, it is recommended to include the database name in the DATABASE_URL.

๐Ÿ•น๏ธ Getting Started

Environment Variables

# Name Type Description Default
1 ACTIVE_PROFILE String Spring profile name -
2 PORT int Service port 8080
3 DATABASE_URL String Database path url -
4 DATABASE_NAME String Database schema name -

Spring Environment Properties

# Name Type Description Default
1 spring.data.mongodb.uri String Mongodb URI -
2 spring.data.mongodb.database String Mongodb database name -
3 prices.crawler.cache.enabled Boolean Cache service true
4 prices.crawler.history.enabled Boolean Prices history service true
5 prices.crawler.product-incident.enabled Boolean Product incident check true
6 prices.crawler.controller.catalog.enabled Boolean Catalog controller false
7 prices.crawler.controller.product.list.enabled Boolean Product controller false
8 prices.crawler.controller.product.search.enabled Boolean Product controller false
9 prices.crawler.controller.product.parser.enabled Boolean Product controller false
10 prices.crawler.controller.product.history.enabled Boolean Product controller false
11 prices.crawler.background.service.cron String Cron string 0 0 0 * * *
12 prices.crawler.product.data.hintsEnabled String Product hints enabled true
13 prices.crawler.product.data.searchTermsEnabled String Product search terms enabled true

MongoDB Configurations

  • To ensure maximum performance create the following indexes:
    • Collection: products
      • eanUpcList_1

Notes

pricescrawler_content-base's People

Contributors

scafer avatar dependabot[bot] avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.