Crawler Agents Guide
Parent Guide: Root AGENTS.md
This guide extends the root conventions with Crawler-specific rules.
This module is part of the open4goods multi-module Maven project.
Technology
- Java 21
- Spring Boot 3
Directory structure
src/main/java– crawler implementationsrc/main/resources– configurationsrc/test/java– unit testslibs– third party crawler libs
Purpose
The crawler module retrieves product information from external sources and feeds the open4goods data pipeline.
Build and test this module only
From this directory:
mvn --offline clean install
Run only the tests with:
mvn --offline test
From the repository root you can also execute:
mvn --offline -pl crawler -am clean install