Converstaional AI / Chatbot QA Test Analyst

Description:

We are seeking a skilled Quality Assurance Analyst to join our team and support testing activities for Kore AI's conversational AI platform. The ideal candidate will have a strong background in software testing, with a focus on AI and natural language processing technologies. The resource will report to the Senior Director of Quality Management and will follow the best practices and standard operating procedures established by the quality assurance team.

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $55 - $60 / hr. w2

* Define functional and non-functional test strategies for the conversational AI platform.

* Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

* Conduct rigorous testing of conversational AI models, including:

o Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

o Performance testing to evaluate response times, system load, and resource utilization.

o Usability testing to assess the user experience and identify areas for improvement.

o Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

o Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

o Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

* Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

* Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

* Track and manage bug resolution and feature enhancements.

* Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

* Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

* Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

* Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

* Research and explore new testing methodologies and tools to enhance the QA process.

• At least 5 years of experience in software testing and quality assurance methodologies.
• Knowledge of AI and machine learning concepts, particularly in natural language processing.
• Expertise in testing conversational AI or chatbot systems.

• Bachelor's degree in computer science, information technology, or related field.