Skip to content

OpenMedKit (Swift Package)

OpenMedKit is the Swift package for running OpenMed models in macOS, iOS, and iPadOS apps.

As of 1.5.2, OpenMedKit supports two Apple backends:

  • MLX for Apple Silicon Macs and real iPhone/iPad devices
  • CoreML for bundled Apple model packages

Swift MLX supports the first OpenMed artifact families used by the public Apple demos:

  • bert
  • distilbert
  • roberta
  • xlm-roberta
  • electra
  • deberta-v2 / DeBERTa-v3-backed experimental GLiNER-family artifacts
  • openai-privacy-filter
  • privacy-filter-nemotron / privacy-filter-multilingual artifacts through the OpenAI Privacy Filter runtime

ModernBERT, Longformer, EuroBERT, Qwen3, and additional architecture families are still part of the broader rollout work.

Requirements

  • iOS 17+ / macOS 14+
  • Xcode 15+
  • For MLX:
  • Apple Silicon Mac, or
  • a real iPhone/iPad device
  • For CoreML:
  • a compatible .mlpackage or .mlmodelc bundle plus id2label.json

iOS Simulator is not a Swift MLX validation target.

Apple Platform Matrix

Use case Recommended path
Python on Apple Silicon Mac openmed[mlx]
Swift app on Apple Silicon macOS OpenMedKit + MLX or CoreML
Swift app on real iPhone/iPad OpenMedKit + MLX or CoreML
Swift app on iOS Simulator CoreML only
Older Apple OS support CoreML

Install OpenMedKit

Xcode

  1. Open your app project in Xcode.
  2. Choose File > Add Package Dependencies...
  3. Enter https://github.com/maziyarpanahi/openmed
  4. Add the OpenMedKit product to your app target

Swift Package Manager

dependencies: [
    .package(url: "https://github.com/maziyarpanahi/openmed.git", from: "1.5.2"),
]

Then add the product:

.target(
    name: "YourApp",
    dependencies: [
        .product(name: "OpenMedKit", package: "openmed"),
    ]
)

Quick Start: Swift MLX

This is the new on-device path for supported OpenMed MLX artifacts.

import OpenMedKit

let modelDirectory = try await OpenMedModelStore.downloadMLXModel(
    repoID: "OpenMed/OpenMed-PII-ClinicalE5-Small-33M-v1-mlx"
)

let openmed = try OpenMed(
    backend: .mlx(modelDirectoryURL: modelDirectory)
)

let entities = try openmed.extractPII(
    "Patient John Doe, DOB 1990-05-15, SSN 123-45-6789"
)

That MLX model directory must contain:

  • openmed-mlx.json
  • config.json
  • id2label.json
  • tokenizer assets
  • weights.safetensors preferred, weights.npz fallback

The same converted MLX artifact is now intended to work in both:

  • Python on Apple Silicon
  • Swift via OpenMedKit

OpenMedKit prefers the new self-contained artifact layout above. For older MLX repos that were uploaded before openmed-mlx.json and tokenizer asset bundling, it also keeps backward compatibility by falling back to config.json plus the source Hugging Face tokenizer reference when available.

Quick Start: CoreML

CoreML is still supported and remains the right path when you already have an Apple model bundle or need a non-MLX fallback.

import OpenMedKit

let modelURL = Bundle.main.url(forResource: "OpenMedPII", withExtension: "mlmodelc")!
let labelsURL = Bundle.main.url(forResource: "id2label", withExtension: "json")!

let openmed = try OpenMed(
    backend: .coreML(
        modelURL: modelURL,
        id2labelURL: labelsURL,
        tokenizerName: "OpenMed/OpenMed-PII-ClinicalE5-Small-33M-v1",
        tokenizerFolderURL: nil
    )
)

let entities = try openmed.extractPII("Patient John Doe, SSN 123-45-6789")

The convenience initializer remains available:

let openmed = try OpenMed(
    modelURL: modelURL,
    id2labelURL: labelsURL,
    tokenizerName: "OpenMed/OpenMed-PII-ClinicalE5-Small-33M-v1"
)

Downloading MLX Models From Hugging Face

OpenMedKit includes a built-in downloader and local cache for Hub-hosted MLX artifacts:

let modelDirectory = try await OpenMedModelStore.downloadMLXModel(
    repoID: "OpenMed/OpenMed-PII-FastClinical-Small-82M-v1-mlx",
    revision: "main"
)

Behavior:

  • downloads openmed-mlx.json first
  • downloads the config, labels, tokenizer assets, and available weight files
  • caches the model under the app cache directory
  • returns a local directory URL ready for OpenMedBackend.mlx

If a repo predates the manifest rollout, OpenMedKit falls back to the legacy layout and downloads the available config, labels, weights, and any bundled tokenizer files it can find.

Offline Tokenizer Assets

For MLX artifacts, tokenizer assets travel with the converted model directory, so Swift can load them locally without going back to the Hub.

For CoreML bundles, you can still bundle tokenizer assets manually and pass tokenizerFolderURL:

let openmed = try OpenMed(
    modelURL: modelURL,
    id2labelURL: labelsURL,
    tokenizerFolderURL: Bundle.main.url(forResource: "TokenizerAssets", withExtension: nil)
)

Public API

OpenMedBackend

public enum OpenMedBackend: Sendable {
    case coreML(
        modelURL: URL,
        id2labelURL: URL,
        tokenizerName: String,
        tokenizerFolderURL: URL?
    )
    case mlx(modelDirectoryURL: URL)
}

OpenMed

public final class OpenMed {
    public init(
        backend: OpenMedBackend,
        maxSeqLength: Int = 512
    ) throws

    public convenience init(
        modelURL: URL,
        id2labelURL: URL,
        tokenizerName: String = "OpenMed/OpenMed-PII-ClinicalE5-Small-33M-v1",
        tokenizerFolderURL: URL? = nil,
        maxSeqLength: Int = 512
    ) throws

    public func analyzeText(
        _ text: String,
        confidenceThreshold: Float = 0.5
    ) throws -> [EntityPrediction]

    public func extractPII(
        _ text: String,
        confidenceThreshold: Float = 0.5,
        useSmartMerging: Bool = true
    ) throws -> [EntityPrediction]
}

extractPII(...) now follows the Python PII path more closely by applying span repair plus semantic-unit merging for fragmented dates, SSNs, phone numbers, emails, and similar PII spans.

OpenMedModelStore

public enum OpenMedModelStore {
    public static func downloadMLXModel(
        repoID: String,
        revision: String = "main",
        cacheDirectory: URL? = nil
    ) async throws -> URL
}

Supported Swift MLX Families

The current Swift MLX runtime is the BERT-family token-classification path shared across:

  • BERT
  • DistilBERT
  • RoBERTa
  • XLM-RoBERTa
  • ELECTRA

This is the same first-phase scope as the current public Python MLX BERT-family implementation.

Demo App

The demo app in swift/OpenMedDemo/ now exposes:

  • bundled CoreML models discovered from the app target
  • a searchable catalog of Swift-MLX-compatible OpenMed PII models
  • public OpenMed MLX artifact download, local caching, and offline reuse

On Apple Silicon macOS or a physical iPhone/iPad, the demo can download a supported MLX artifact and run it locally through OpenMedKit.

CoreML Status

CoreML remains part of the public Apple story, but it is no longer the only Swift path.

Use CoreML when:

  • you already have a bundled Apple model package
  • you want an older-OS fallback
  • you are validating an app path that already depends on CoreML packaging

For the current CoreML packaging status, see CoreML packaging status.

Notes On Testing

The Swift MLX runtime is intended for:

  • Apple Silicon macOS app builds
  • real iPhone/iPad hardware

Command-line swift test may skip the MLX execution tests if the local test environment does not package MLX runtime Metal resources. That does not change the supported app runtime targets above.