Suggested Caliper Analytics Requirements for Institutional RFP & Procurement Agreements
Current and Future Metric Profiles
-
Suggested RFP wording and clauses for requiring Caliper Analytics (open inquiry to stringent specification):
-
Meets the latest Caliper Analytics Specifications (https://www.imsglobal.org/caliper/caliperv1p0/ims-caliper-analytics-conformance-and-certification-guide-v10 ). Describe.
-
[The Institution name] is committed to a standards-based interoperable teaching and learning technology ecosystem. We are requesting [vendor/product] obtain certification by 1EdTech as a tool provider for Caliper Analytics version [specify] and the following profiles [specify] no later than [insert specific date].
-
[The Institution name] is requiring support for Caliper Analytics version [specify] and the following metric profiles [specify] and the tool consumer (LMS) must be certified as compliant with 1EdTech Caliper Analytics conformance certification. The vendor is required to provide a valid, current conformance certification registration number. See imscert.org. The vendor is also required to remain current with the subsequent Caliper Analytic versions, metric profiles and receive certification within a “reasonable” [define] time period.
-
-
Additional Caliper Analytics requirements to consider:
-
Data generated by student/faculty interaction with the [specific tool provider], whose stewardship is the responsibility of the institution of which those individuals are members.
-
[Specify tool provider] will provide to the transport protocol and institution with a real-time data stream in a Caliper format with specific user events to be defined in consultation with the institution.
-
The tool provider will also provide buyer access to a file containing monthly aggregations <a full ‘replay’ log?> of user activity data in Caliper format.
-
-
Suggested Guidelines
-
Verify that the vendor is 1EdTech certified for Caliper and have the vendor provide their certification number as listed in the 1EdTech product directory.
-
Any features of the specified Caliper Analytics version that are not supported by the tool, or if there are custom parameter substitution variables that are supported, these should be noted explicitly in the RFP response. See the conformance overview at https://www.imsglobal.org/caliper/caliperv1p0/ims-caliper-analytics-conformance-and-certification-guide-v10#2
-
Cloud-hosted application providers shall provide content that is certified compliant with Caliper Analytics and whatever metric profiles are relevant to the institution’s application. Evidence of a valid certification, including a current 1EdTech certified registration number, must be provided to the institution. See http://www.imscert.org/.
-
The vendor partner is required to disclose what parameters, variables, and services the tool requires so it can be matched and supported by the tool consumer or tool provider. The partner is also required to disclose optional services used.
-
- Clear articulation as to ownership of the data.
- Clear articulation and agreement specific to learning data privacy and security.
- Sign FERPA agreement.
- Is student identified data really necessary for the performance of the tool?
- Tool consumer must provide an ISO security review.
- Frequency and formatting of the data collected by the tool (ideally, daily and in Caliper Analytics format).
- Is data synced between devices, cloud services, the client and the tool consumer (LMS)?
- Where data is stored and how long?
- When data is removed, how is the data removed, deleted or erased?