Form cover
Page 1 of 2

Software Engineer (Inference APIs)

ABOUT THE SOFTWARE ENGINEER INFERENCE/APIS ROLE AT GENHEALTH

GenHealth.ai is transforming the way healthcare works, and we are looking for an exceptional Software Engineer to join our team and build our backend and APIs. As a member of our team, you will be at the forefront of generative AI in healthcare, making a significant impact on the lives of patients around the world.

You will specifically build the APIs for our Large Medical Model (LMM) and our chat application G-Mode which enables analytics on top of our LMM using off the shelf Large Language Models (LLMs).

The Inference API Engineer role at GenHealth will develop and deploy APIs on top of state-of-the-art generative AI medical models built by the GenHealth team as well as public LLMs. You will work with a team of passionate and talented individuals with a track record of successful startups who are dedicated to improving patient outcomes and reducing healthcare costs.

Responsibilities

Security, security, security. We work with healthcare data so security is of the upmost importance. You need to know thinks like authentication, authorization, and various standards for implementing those.
Hands on keyboard development of APIs securing and providing access to our generative AI models
Scaling APIs to support thousands of concurrent requests per second
Support API streaming at scale while being mindful of performance
Collaborate with healthcare professionals to identify new use cases and opportunities for AI in healthcare
Work with a team of data scientists and engineers to build application programming interfaces on top of generative AI models
Stay up-to-date with the latest developments in AI and healthcare technology
Use EHR, FHIR, or Claims data to understand the usage and domain of healthcare applications

Requirements

Strong background in Python AND Javascript (Node.js) software development with experience in developing and deploying AI models in production
Experience with Next.js, Express, Flask, FastAPI or other server side API frameworks
Be familiar with generative AI model concepts like tokens, vocabulary, embeddings, attention, RAG, vector DBs, etc.
Ability to produce working prototypes quickly and scale that to production level usage (think 100,000s requests per minute)
An expert intuition at understanding development tradeoffs with regard to development speed, stability, system design and architecture
Understanding of various authorization and account connectivity standards like OAuth2, SAML, ActiveDirectory
Understand how to mitigate security risks with authentication, rate-limiting, and security led design
Experience with Cloud Operations and automating deployment, testing, and scaling including Docker and Terraform
Deft with shell, CI/CD, and cloud environments like AWS or GCP to connect and provision resources
Experience working with EHR, FHIR, Claims or other healthcare data
Experience with SQL and Columnar databases
Prior work or personal experience with public LLM APIs
Passion for making a significant impact on the healthcare industry using AI
Must be US citizen or permanent resident, and currently living in the US

Compensation & Benefits

The salary for this role is $100,000 – $200,000. In addition to salary, total compensation includes the following
- Healthcare, dental, and vision insurance for your entire family
- Equity (stock options) valued between $25,000 - $100,000.
- Unlimited vacation and 15+ company holidays per year
- Work directly with the founders

At GenHealth.ai, we are transforming the healthcare industry with cutting-edge Generative AI technology. As an Engineer at our company, you will work on projects that will improve the lives of millions of patients around the world. If you are passionate about using AI to make a significant impact on the healthcare industry and have experience in scaling Transformer Neural Network in production, we encourage you to apply today!

We take pride in our focus on equity. We are a proud equal opportunity employer and encourage individuals from all backgrounds and identities to apply for this position. We believe in fostering an inclusive and diverse workplace and are committed to supporting our employees’ professional growth and development.

Tell us a bit more about yourself

Upload your Resume

Cover Letter

Anything else we should know?

How did you hear about this job?

How did you hear about this job?
A
B
C
D

If a current employee at (company) referred you, please list his/her name