Hello This is Nagesh Bsshyam (a.k.a Dragon) working as part of the Inferno support team. Our team has recently started to provide support for Inferno tools. We will be getting back to you on the open questions over the next week. Thank you for your patience. If you are at the HL7 Connectathon, please stop by and say hello. we are hanging out at tables 46 and 47.

Hello, We are seeing errors in the public inferno instance. There is a socket timeout issue even before running the tests. When the single api and multi patient api tests are run, they stall. Anything in terms of when this may be fixed? Screenshot 2025-09-16 at 2.48.25 PM.png Screenshot 2025-09-16 at 2.48.38 PM.png

(deleted)

This is the specific error I'm seeing Screenshot 2025-09-16 at 3.09.10 PM.png

@Nagesh Bashyam do you have any insight to the above issue?

@Nagesh Bashyam Getting error while running G10 Standardized API Test suite. image.png

@Nagesh Bashyam DocumentReference resource test #10.12.04 has only 1 successful call and seems like other calls are not working. When tried locally, all the follow-up calls with different date combinations are working fine and not timing out. TimeoutError.png

Jacob/Yogesh Sorry about the delay in the response. We did some analysis and actually ran the test kit with multiple servers and we dont see any systemic issue with the test tool itself. It does look like some configuration is not setup properly based on the message. I am assuming you have looked through the following documentation https://github.com/onc-healthit/onc-certification-g10-test-kit/wiki/Walkthrough on how to use the tool. Let us know if you are following the steps indicated appropriately for your server.

Sandeep, I am not understanding the specific question, I am seeing in the screenshot most of your test cases are passing except the one timeout. Can you clarify what the question is ?

Nagesh Bashyam said : Sandeep, I am not understanding the specific question, I am seeing in the screenshot most of your test cases are passing except the one timeout. Can you clarify what the question is ? Hi @Nagesh Bashyam Inferno test 10.12.04 makes total 6 documentreference requests with different search parameter combinations, is what we have observed but, we only see one request made which was responded successfully by our servers and rest of the calls from inferno did not reach our servers and therefore the test times out. e.g. we only see date equal to call from inferno, which is responded successfully, but not other calls such as date greater than, date less than or date less than equal to etc. Below is the link to our inferno session: https://inferno.healthit.gov/suites/g10_certification/a4nTLf5YkGt#10

Hi @Nagesh Bashyam and Inferno team, I’m reaching out for guidance on how best to use the Inferno test kit to validate our EHR prior authorization service, specifically our CRD, DTR, and PAS client implementations. A few questions: We’re implementing the EHR/client side, with support for CDS Hooks (such as order-sign), DTR (including get-questionnaire and next-questionnaire), and PAS (including claim submission and claim status query). Could you confirm which of these hooks and scenarios are currently covered in the Inferno client test suites? Are there step-by-step instructions or documentation on how to test client-side integrations—especially for CRD order-sign, DTR, and PAS workflows, if available? Would it be possible for someone on your team to provide a live demo, a recorded video, or a walkthrough meeting on how to perform these tests and interpret the results? If certain hooks or features (like order-sign or specific DTR/PAS operations) are not yet included, are there plans or timelines for when they might be added? Thank you in advance for your help and for the ongoing development of these valuable open-source toolkits!

There is a bug in Inferno in one of the Coverage tests. I originally reported this on #united states > Coverage.payor . I started a PM with Yunwei Wang who indicated "We have an internal ticket to investigate possible solution, which depends on what FHIR validator API allows external caller to do. We don't have a timeline for a solution at this time." When I asked for a follow up he sent me here. The issue is on 10.8.04. If you use a contained reference for Coverage.payor then this error will occur. coverage.png { "resourceType" : "Coverage" , "id" : "id-1.1.8386.BB.1" , "contained" : [ { "resourceType" : "RelatedPerson" , "id" : "1" , "patient" : { "reference" : "Patient/id-1.1.8386" }, "name" : [ { "text" : "HOLBERG HTI-1" , "family" : "HOLBERG" , "given" : [ "HTI-1" ] } ], "gender" : "female" , "birthDate" : "2020-04-01" , "address" : [ { "line" : [ "PO BOX 1233" ], "city" : "MOBILE" , "state" : "AL" , "postalCode" : "36695" } ] }, { "resourceType" : "Organization" , "id" : "2" , "identifier" : [ { "use" : "official" , "type" : { "coding" : [ { "system" : "http://terminology.hl7.org/CodeSystem/v2-0203" , "code" : "TAX" } ] }, "system" : "urn:oid:2.16.840.1.113883.4.4" , "value" : "460391067" }, { "use" : "official" , "type" : { "coding" : [ { "system" : "http://hl7.org/fhir/us/carin-bb/CodeSystem/C4BBIdentifierType" , "code" : "payerid" } ] }, "value" : "00350" }, { "system" : "http://cpsi.com/identifiers/organization/financial-class" , "value" : "BB" } ], "active" : true , "name" : "BLUECROSSBOFCALA-O/P-LONGNAMETEST" , "telecom" : [ { "system" : "phone" , "value" : "2055544321" } ], "address" : [ { "line" : [ "123 TEST ST" ], "state" : "AL" , "postalCode" : "12345678" , "country" : "US" } ] } ], "identifier" : [ { "type" : { "coding" : [ { "system" : "http://terminology.hl7.org/CodeSystem/v2-0203" , "code" : "MB" , "display" : "Member Number" } ] }, "system" : "http://trubridge.com/identifiers/coverage/member-number" , "value" : "1234567" } ], "status" : "active" , "type" : { "coding" : [ { "system" : "https://nahdo.org/sopt" , "code" : "3223" , "display" : "Children of Women Vietnam Veterans (CWVV)" }, { "system" : "http://terminology.hl7.org/CodeSystem/v3-ActCode" , "code" : "HIP" , "display" : "health insurance plan policy" } ], "text" : "Children of Women Vietnam Veterans (CWVV)" }, "subscriber" : { "reference" : "#1" }, "subscriberId" : "123456702" , "beneficiary" : { "reference" : "Patient/id-1.1.8386" }, "relationship" : { "coding" : [ { "system" : "http://terminology.hl7.org/CodeSystem/subscriber-relationship" , "code" : "self" , "display" : "self" }, { "system" : "http://terminology.hl7.org/CodeSystem/v3-RoleCode" , "code" : "NIENE" , "display" : "niece/nephew" }, { "system" : "http://cpsi.com/CodeSystem/subscriber-relationship" , "code" : "18" , "display" : "self" } ], "text" : "self" }, "payor" : [ { "reference" : "#2" } ], "class" : [ { "type" : { "coding" : [ { "system" : "http://terminology.hl7.org/CodeSystem/coverage-class" , "code" : "group" , "display" : "Group" } ] }, "value" : "Grpnumber" , "name" : "Grpname" } ], "order" : 1 }

Getting this error now, is the terminology server down or issue with health-samurai? Validator Response: HTTP 500 "Unable to connect to terminology server at http://tx.fhir.org . Use parameter \u0027-tx n/a\u0027 to run without using terminology services to validate LOINC, SNOMED, ICD-X etc. Error \u003d org.hl7.fhir.exceptions.FHIRException: Error fetching the server\u0027s capability statement: Error from https://tx.fhir.org/r4 : Unparseable HTML" NM, back up now.

(deleted)

James Dinsmore said : There is a bug in Inferno in one of the Coverage tests. I originally reported this on #united states > Coverage.payor . I started a PM with Yunwei Wang who indicated "We have an internal ticket to investigate possible solution, which depends on what FHIR validator API allows external caller to do. We don't have a timeline for a solution at this time." I've been able to reproduce. The validator is having trouble finding a definition for the carin identifier type code system ( http://hl7.org/fhir/us/carin-bb/CodeSystem/C4BBIdentifierType ) . Inferno filters and disregards those errors when they appear in the root resource, but does not when they appear in a contained resource. I don't think that a configuration change in terms of how Inferno is invoking the validator API will fix it, but the validator does seem to be giving Inferno enough information for us to see and filter errors during conformance checks on the contained resource. I'm running a potential solution by the Inferno team and will update you when I have more information about where it sits on the roadmap.

@James Dinsmore We have a solution that will work for the specific case you've reported, but are hoping to generalize it to handle some other cases for IGs such as PAS before releasing in March. However, we wanted to make sure that this issue isn't blocking your certification. If it was, we would target an initial release this month. Please let us know if this is critical to get in for your certification.

Hi, Is anyone maintaining fhir_client? It would be great if we could get in an update to the oauth2 gem . Thanks

Hi Rob - we can try to look into it this month, though the team has some other priorities, so I can't promise. It looks like this has been requested for a while. Do you know why it might not have been done by the MITRE team. Is this a big change to the gem that will require significant rework? If you're not sure, I can put on my list to investigate.

Hi, This may be a dumb question. But just wanted to understand, if Inferno works for any other geographics other than US and just with us-core-profile. Has this been used for any other profiles like UK or Australia or Ireland etc?

Yes, Inferno supports writing tests for non-us-realm IGs. See for example the AU Core test kit published by HL7 Australia.

is there a public inferno testing server for australia?

sorry found one

Hi team, minor issue in the doc, the two links under https://inferno-framework.github.io/docs/writing-tests/assertions-and-results.html#adding-messages-to-results is no longer valid. (I'm assuming the code has been moved to https://inferno-framework.github.io/inferno-core/docs/Inferno/Entities/Message.html recently)

@Rob Passas The v6.1.0 release of the fhir_client gem includes an update to the oauth2 gem. Thanks for using Inferno and let us know if you have any trouble with update.

@Karl Naden Thank you for addressing this! Sorry I missed your earlier message.

Xun Ma said : Hi team, minor issue in the doc, the two links under https://inferno-framework.github.io/docs/writing-tests/assertions-and-results.html#adding-messages-to-results is no longer valid. (I'm assuming the code has been moved to https://inferno-framework.github.io/inferno-core/docs/Inferno/Entities/Message.html recently) Thanks for the catch - opened a PR to resolve