AI Product Relevance Evaluator

Job Description

• About the Role

At Core AI, we collaborate with some of the world’s leading brands to create smarter, more intuitive digital experiences. As an AI Product Relevance Evaluator, you will play a key role in training AI systems to recognize high-quality shopping recommendations. Your work will help ensure that customers are shown products that naturally complement one another rather than irrelevant or mismatched suggestions.

In essence, you’ll be the quality gatekeeper behind the scenes, helping create seamless and intelligent online shopping experiences.

Key Responsibilities

Develop Product Associations

Identify and match products based on factors such as color, style, texture, design, and overall visual appeal, ensuring recommendations feel cohesive and relevant.

Verify Product Compatibility

Assess whether products genuinely work together in practical situations. This may involve distinguishing between specialized product types, such as equipment designed for gravel cycling versus road cycling, or confirming that accessories are compatible with specific technical requirements.

Evaluate Product Metadata

Review attributes including target audience, pricing category, seasonal relevance, and market positioning to ensure recommendations are both commercially appropriate and contextually accurate.

Ensure Data Accuracy and Consistency

Manage, organize, and validate product matching datasets while adhering to established category guidelines and brand standards.

Research New Product Categories

Quickly familiarize yourself with unfamiliar product segments and niche markets, such as fitness equipment, cycling disciplines, or winter sports gear, to make informed and accurate recommendation decisions.

Qualifications

Required Criteria

Relevant Experience: Previous experience in search relevance, product categorization, e-commerce annotation, content moderation, or related fields is highly preferred.
Education: Bachelor’s degree in any discipline.
Analytical Skills: Ability to rapidly learn and understand technical differences between products across a wide range of categories.
Attention to Detail: Strong ability to identify visual inconsistencies, pricing mismatches, and subtle recommendation errors.
Productivity: Comfortable working with large-scale product catalogs and high-volume SKU datasets.
English Proficiency: Minimum B1 (Intermediate) level, with the ability to read and understand product documentation and specifications.
Assessment Process

Candidates will be required to complete a role-specific qualification assessment designed to measure their suitability for the position. Standard identity verification procedures will also be part of the application process.

Why Join Core AI?

Work with a Global Community

Collaborate remotely with a diverse network of AI contributors from around the world.

Make a Meaningful Impact

Contribute directly to AI systems that power real-world shopping and search experiences.

Gain Valuable AI Experience

Build practical expertise in AI training, evaluation, data quality, and relevance optimization.

Collaborate Across Industries

Work alongside professionals and specialists from a variety of industries, disciplines, and language backgrounds.

Enjoy Flexible Working Arrangements

Choose your own schedule while contributing to innovative AI projects with real-world applications.

Equal Opportunity Statement

Core AI is committed to providing equal opportunities to all applicants. Hiring and selection decisions are based solely on qualifications, skills, and performance. We do not discriminate on the basis of race, religion, gender, nationality, disability, or any other protected characteristic. We are dedicated to fostering an inclusive and diverse global contributor community.