As a University of Applied Learning, the Singapore Institute of Technology (SIT) works closely with industry in its research pursuits. This position is situated within the Centre for Immersification, dedicated to applied research in immersive technologies and bridging the gap between academia and industry. Research staff at the Centre have the opportunity to be equipped with applied research skill sets relevant to industry demands while working on innovative projects within the university.

The primary responsibility of this role is to contribute to the design, development, and deployment of an advanced content moderation framework for immersive 3D virtual environments, such as Roblox and Minecraft. The engineer will play a key role in building a parallelized, agent-driven exploration system and integrating a multimodal detection pipeline, ensuring real-time performance, scalability, and deployment readiness in alignment with the project’s research objectives.

The successful candidate will work with a diverse team of faculty members, engineers, and industry partners, including renowned researchers at the College of Computing and Data Science (CCDS) at NTU. Technical skills, natural curiosity, versatility, and enthusiasm are highly desired traits that will enable success in this fast-paced environment.

Key Responsibilities

• Manage the research project together with Principal Investigator (PI), Co-PI and the research team members to ensure all project deliverables are met.
• Collaborate with the PI, Co-PIs and NTU team to design and develop a robust and scalable software system for autonomous agents navigating immersive 3D virtual environments (e.g., Roblox, Minecraft).
• Implement a parallelized agent-driven framework where multiple LLM-powered agents operate concurrently to explore user-generated worlds and trigger diverse contextual scenarios.
• Develop a unified multimodal detection pipeline that integrates video, audio, and text leveraging fine-tuned Vision-Language Models (VLMs) from WP3, supporting zero-shot reasoning and scene-graph inference.
• Ensure the system is deployment-ready by supporting benchmarking of inference speed, compute efficiency, and scalability with concurrent agents.
• Enable real-time adaptive learning via human-in-the-loop feedback and reinforcement learning mechanisms in collaboration with other work packages.
• Maintain high software engineering standards through rigorous testing, version control, clear documentation, and continuous improvement of development infrastructure (e.g., CI/CD, Docker, cloud-based services).
• Carry out Risk Assessment, and ensure compliance with Work, Safety and Health Regulations.
• Coordinate procurement and liaison with vendors/suppliers.
• Work independently, as well as within a team, to ensure proper operation and maintenance of equipment.

Job Responsibilities

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Software Engineering, or a related field.
• Hands-on experience in designing and implementing software systems involving multi-agent frameworks.
• Familiarity with immersive platform development (e.g., Roblox, Minecraft), including scripting (Lua/Java), agent behavior modeling, event handling, and API-based integration with external AI systems.
• Experience with distributed systems, reinforcement learning, or simulation environments (e.g., Unity3D, OpenAI Gym, WebGL) is advantageous.
• Experience in developing and deploying cloud-based applications (e.g., AWS, Google Cloud, Microsoft Azure), including containerization (Docker), orchestration (Kubernetes), serverless computing, and REST API development.
• Proficient in Python, with basic experience in machine learning or computer vision libraries; familiarity with Vision-Language Models (e.g., CLIP, BLIP) or scene-graph inference is a plus.

Key Competencies

• Strong software development and debugging skills.
• Able to design modular, scalable systems and benchmark their performance.
• Proficient in technical writing and system documentation.
• Self-directed learner with strong problem-solving and research capability.