Senior Data and AI Analyst

About Us

Auditoria is an AI-driven SaaS automation provider for corporate finance that automates back-office business processes involving tasks, analytics, and responses in Vendor Management, Accounts Payable, Accounts Receivable, and Planning. By leveraging natural language processing, artificial intelligence, and machine learning, Auditoria removes friction and repetition from mundane tasks while automating complex functions and providing real-time visibility into cash performance. Corporate finance and accounting teams use Auditoria to accelerate business value while minimizing heavy IT involvement, improving business resilience, lowering attrition, and accelerating business insights.

Founded in 2019 and backed by Venrock, Workday Ventures, Neotribe Ventures, Engineering Capital, and Firebolt Ventures, we build intelligent automation by combining fine-grained analytical orchestration of a company’s typical financial and audit workflows with conversational AI, delivering rapid value to the finance/audit back office.

In 2021, Auditoria earned industry recognition by being named to the Intelligent Apps Top 40 List, SSON’s Shared Services & Outsourcing Impact Awards, the Constellation Research ShortList for AI-Driven Cognitive Applications, HFS Research Hot Vendors, 2021 CRN Emerging Vendors List, TiE50 Award, and the winner of the inaugural Pitch Event by Constellation Research.

Since then, Auditoria was again named to the Constellation Shortlist for a record four consecutive years (‘20, ‘21, ‘22, ‘23). In 2022, Gartner named Auditoria a “Cool Vendor in Finance,” a curated list of solutions that challenge the traditional finance software market. In 2023, CRN once again recognized Auditoria as a Finalist for the CRN Tech Innovators Award. The SaaS Awards named Auditoria as a 2023 SaaS Awards Finalist for Best SaaS for Improved Productivity (USA). Most recently Auditoria was named a finalist for the 2023 SSON Impact Awards for Technology of the Year.

The Opportunity for You

We’re seeking a Senior Data and AI Analyst to drive insights across both our AI platform performance and business operations. You’ll work at the intersection of AI, financial operations, and advanced analytics, helping to optimize our AI models, evaluate automation effectiveness, and deliver data-driven value to enterprise clients. This role combines traditional business analysis with the exciting challenge of measuring and improving AI system performance.

Key Responsibilities

Business Process Analysis

• Design and maintain comprehensive analytics frameworks for business processes and financial workflows
• Develop dashboards and reports that provide real-time insights into key business metrics
• Analyze user interaction patterns with AI features to improve adoption and effectiveness
• Create and maintain ETL pipelines (if necessary) to ensure data quality and accessibility
• Generate actionable insights from complex financial datasets to guide product strategy

AI Platform Analysis

• Develop and implement frameworks to evaluate the performance of LLM-based systems and AI agent.s
• Analyze AI model outputs, response quality, and automation effectiveness
• Track and report on key AI performance metrics such as accuracy, latency, and automation rates
• Collaborate with ML engineers to identify areas for model improvements based on data insights
• Create dashboards for monitoring AI system performance and reliability
• Conduct A/B testing of different AI configurations and prompt strategies

Strategic Impact

• Provide data-driven recommendations for improving both AI capabilities and business processes
• Partner with product teams to define and track success metrics for AI features
• Collaborate with customer success teams to analyze user feedback and AI system effectiveness
• Build and maintain documentation for AI performance metrics and analytics processes

Qualifications

Required Qualifications

• 5+ years of experience in data analysis, with recent exposure to AI/ML systems
• Strong proficiency in SQL and Python for data manipulation and analysis
• Experience analyzing AI/ML system performance and metrics
• Expert-level experience with business intelligence tools (e.g., Tableau, Power BI, Looker)
• Experience working with large-scale financial datasets and ETL processes
• Strong statistical analysis skills and experience with A/B testing
• Experience with cloud-based data warehouses (preferably Snowflake)
• Bachelor’s degree in Statistics, Mathematics, Computer Science, or related field

Preferred Qualifications

• Experience analyzing LLM-based systems and generative AI applications
• Knowledge of NLP metrics and evaluation frameworks
• Experience with financial systems and processes (AP, AR, Vendor Management)
• Familiarity with prompt engineering and LLM performance optimization
• Experience with real-time analytics and streaming data
• Knowledge of data privacy and compliance requirements in finance
• Master’s degree in related field

Technical Skills

Data Analysis & Visualization

• Python (Pandas, NumPy, Matplotlib, Seaborn, Plotly, Dash)
• SQL (expert-level analytics)
• Tableau/Power BI/QuickSight
• Excel (advanced)

AI/ML Analytics

• LLM evaluation metrics
• AI monitoring frameworks
• Prompt effectiveness analysis

Data Infrastructure

• Snowflake or similar data warehouses
• AWS/Azure data services
• Experience with ETL tools and frameworks
• Data modeling

Statistics & Testing

• Statistical analysis
• A/B testing
• Hypothesis testing
• Experimental design

Business & Domain

• Financial metrics
• SaaS metrics
• Process optimization
• Data governance

What We Offer

• Competitive startup compensation package
• Early-stage equity options
• Comprehensive health benefits
• Unlimited PTO
• Flexible work environment
• Opportunity to shape the future of AI in enterprise finance
• Collaborative, innovation-driven culture

Auditoria.AI is an equal-opportunity employer committed to building a diverse and inclusive team. We welcome candidates of all backgrounds passionate about combining cutting-edge AI with practical business solutions.