Overview
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
Responsibilities
* Create functional black box tests for large codebases in various source languages
* Create and manage Docker environments to ensure 100% reproducible builds and test execution across different platforms
* Monitor code coverage and configure automated scoring criteria to meet industry benchmark-level standards
* Leverage LLMs to accelerate development cycles, automate repetitive tasks, and improve overall code quality
Qualifications
* 5+ years of experience as a Software Engineer (primarily Python)
* Deep experience with pytest (fixtures, session-scoped, timeouts) and designing black-box functional tests for CLI tools
* Expert-level Docker skills (reproducible Dockerfiles, user contexts, secure workspaces)
* Strong Linux & Bash scripting skills and comfort debugging inside containers
* Proficiency with modern Python tooling (uv, pyproject.toml, packaging)
* Ability to read and understand multiple coding languages (e.g., C, C++, Rust, Go) with support from LLMs
* Experience using LLMs (Claude Code, Roo Code, Cursor) to accelerate iterative development and test-case generation
* English language - B2 or higher
* Prior experience with agent evaluation platforms and MCP CLI
Tools and Technologies
Python (pytest, uv, Pillow), Docker, Bash, Git Submodules, C/C++/Rust/Go (reading), Dagger, GitHub Codespaces, LLMs (Claude Code, Roo Code, Cursor), coverage.py, gcov, kcov.
Benefits
* Freelance project-based collaboration via the Mindrift platform (powered by Toloka AI)
* Fully remote and flexible participation — choose when and how much to contribute (20-30 hours per week)
* Each project has its own compensation level based on scope and expertise required. On this project, AI trainers earn up to $45 per hour equivalent
* Opportunity to contribute to innovative AI projects for leading tech companies
* Supportive global community
#J-18808-Ljbffr