About the Role
Mantra Inc. is a global AI startup dedicated to eliminating “language barriers” in the entertainment industry, guided by our mission to “deliver manga in the world’s languages.” We envision a future where people everywhere can enjoy the latest manga, anime, and games simultaneously, and engage in conversations that transcend national borders and cultural differences. We believe that the “respect for other cultures” born from a love for these works and interactions among fans will eventually foster mutual understanding around the world. Envisioning such a peaceful and joyful future, we are dedicated to researching AI technology, translating manga, and developing language learning services. We are striving to create a world where you can share the latest installment of your favorite manga with fans around the globe in real time. The process of using technology to deliver each panel—imbued with the creator’s soul—to the world “quickly” and “with rich emotion” is filled with intellectual challenges that can only be experienced because of the high technical difficulty involved. We want to turn our skills into a bridge connecting the world. We want to deepen mutual understanding through the power of entertainment and build a better society. We are looking for teammates who share this passion.
Responsibilities
- Conduct research and development related to the translation of entertainment content, such as manga.
- Improve translation accuracy and develop technologies to streamline translation workflows.
- Address challenges in multimodal understanding and generation involving both language and images, including OCR, character recognition, text removal, and style generation for manga images.
- Generate engaging and fluent text for manga dialogue, going beyond simple meaning conveyance.
- Develop methods for automatically evaluating the fluency of narrative translations.
- Consider story and character context, multimodal information, and cultural localization for manga translation.
- Erase original text in manga, appropriately fill in the background, and generate text matching the original style.
- Restore tones and prevent distortion of manga artwork when using diffusion models.
- Train open-source LLMs using manga translation datasets.
- Improve translation accuracy by leveraging historical revision history.
- Develop methods for automatically evaluating machine translation in the entertainment industry.
- Implement speaker estimation for dialogue using multimodal information.
- Perform character recognition of handwritten text and sound effects.
- Utilize diffusion models like Stable Diffusion for text removal and background completion.
- Estimate text styles and generate text with appropriate layouts.
- Perform automatic typesetting based on training with bilingual data.
- Formulate overall research plans with the CTO and NLP researchers.
- Lead the resolution of specific challenges.
- Collaborate with part-time members to advance research.
- Integrate research results into the product in collaboration with web engineers.
- Determine R&D direction in collaboration with the business team.
Requirements
- Research and development experience in the field of natural language processing or image recognition.
- Master’s or doctoral degree in machine learning, or at least two years of relevant professional experience.
- Experience in formulating research plans and conducting research that has resulted in peer-reviewed publications (or equivalent).
- Experience in training machine learning models and improving task accuracy.
- Experience conducting research on English-language academic papers.
- English proficiency sufficient to communicate effectively with non-Japanese speakers.
Skills
- Natural Language Processing
- Image Recognition
- Machine Learning
- Machine Translation
- OCR
- Character Recognition
- Text Removal
- Style Generation
- Multimodal Understanding
- Multimodal Generation
- Large Language Models (LLMs)
- Diffusion Models
- PyTorch
- LangChain
- OpenAI API
- diffusers
- torchserve
- optuna
- W&B
- Expertise in natural language processing and image processing
- Development experience using cutting-edge technologies such as large language models and diffusion models
- Experience as the first author of papers accepted at international conferences and journals in the field of machine learning
- Practical experience as a machine learning engineer
- Experience managing and leading projects such as machine learning proof-of-concepts
- Experience developing applications such as web services
- Continuous learning
- Hypothesis-driven mindset
- Communication with diverse backgrounds
- Ownership and proactive development
- Strong interest in manga, languages, and machine learning
Location
- Tokyo, Japan (Office)
- Remote
Work Type
- Contract
- Full-time
- Hybrid
- Part-time
Experience Level
- 2+ years of professional experience in machine learning
- Master's degree in machine learning
- Doctoral degree in machine learning
Education Level
- Master's degree in machine learning
- Doctoral degree in machine learning
Salary/Compensations
- ¥6,000,000 - ¥10,000,000
Benefits
- Flexible work hours
- Two-day weekend system
- National holidays
- Year-end and New Year holidays
- Annual paid leave
- Special leave for family events
- Telework available
About the Company
- Mantra Inc. is a global AI startup dedicated to eliminating “language barriers” in the entertainment industry, guided by our mission to “deliver manga in the world’s languages.”
- We envision a future where people everywhere can enjoy the latest manga, anime, and games simultaneously, and engage in conversations that transcend national borders and cultural differences.
- We believe that the “respect for other cultures” born from a love for these works and interactions among fans will eventually foster mutual understanding around the world.
- We are dedicated to researching AI technology, translating manga, and developing language learning services.
- We are striving to create a world where you can share the latest installment of your favorite manga with fans around the globe in real time.
- The process of using technology to deliver each panel—imbued with the creator’s soul—to the world “quickly” and “with rich emotion” is filled with intellectual challenges that can only be experienced because of the high technical difficulty involved.
- We want to turn our skills into a bridge connecting the world.
- We want to deepen mutual understanding through the power of entertainment and build a better society.
- We are looking for teammates who share this passion.
