Representative interview topic

Product Manager Interview: Should a B2B SaaS Publish a Public API Changelog?

ProductHard
Offer.cc Editorial TeamPublished Updated

Question

Customers say API changes arrive through private messages and are hard to track or assess. Would you build a public API changelog? Define audiences, change categories, sensitive-information boundaries, channels, metrics, and rollout.

Prompt and Context

Customers say API changes arrive through private messages and are hard to track or assess. You must decide whether to build a public API changelog and define its audiences, change categories, sensitive-information boundaries, notification channels, metrics, and roadmap.

GitHub Releases treats versions, notes, and downloadable assets as a traceable release object. RFC 9745 defines the machine-readable Deprecation response header. These show how release records and runtime signals can complement each other, but they do not decide tenant permissions, breaking-change disclosure, or customer priority.

This case tests developer-product communication and governance. It is distinct from implementing API shutdowns, building a generic documentation center, or pricing long-term API support.

What Interviewers Evaluate

  • Validate whether developers need traceability, impact assessment, or faster support response.
  • Design change records that are stable, filterable, subscribable, and safe to disclose.
  • Separate additions, fixes, behavior changes, security fixes, and breaking changes.
  • Connect the changelog to documentation, SDKs, runtime deprecation signals, and support.
  • Use adoption, migration outcomes, and support cost to decide whether to invest further.

Clarifying Questions to Ask

  1. Are API users public developers, authenticated tenants, partners, or internal teams?
  2. What are current notice coverage, miss rate, support hours, and incidents caused by changes?
  3. What may be public, and what should be limited to affected tenants or contracted customers?
  4. Do customers want RSS, email, webhooks, console alerts, or a version-diff API?
  5. Who owns writing, technical review, legal review, and post-release follow-up?

30-Second Answer Framework

Validate traceability with developer interviews, support cases, and change incidents, then launch a versioned public changelog. Each entry includes impact, action, migration link, date, and breaking-change level; sensitive fixes use controlled channels. Keep the record aligned with documentation, SDKs, and Deprecation signals. Pilot on a high-volume API and measure notice reach, migration conversion, and support hours.

Step-by-Step Deep Dive

1. Define the User Problem and Value

Break “we need a changelog” into discovering capabilities, assessing breaking impact, proving compliance changes, and tracking migration work. Interview developers, technical owners, support, and security teams about how they reconstruct timelines from email, tickets, and documentation.

Segment by traffic, revenue, integration criticality, and change risk. If customers only need critical deprecation notices, a full public timeline may not be first. If they need audit evidence, add version archives and export.

2. Design Change Categories and Minimum Fields

At minimum, separate additions, fixes, behavior changes, deprecations, security fixes, and breaking changes. Each entry contains date, version, affected endpoint or SDK, impact, action, migration deadline, documentation link, and owner.

Do not publish exploit details, tenant names, unannounced promises, or an internal incident investigation. A security fix can start with a bounded description and controlled notice, followed by public detail after the risk window. Use a stable schema rather than marketing-only copy.

3. Choose Public and Controlled Channels

A public changelog fits general additions and version history. An authenticated console can show the endpoints actually used by a tenant. Email, webhooks, or RSS support subscriptions. High-risk security events and contract exceptions need controlled notices with delivery records.

Every channel should point to one canonical entry so email, docs, and console do not show different dates. Support filtering by version, product region, and change level, plus a machine-readable format for customer systems.

4. Connect Runtime and Developer Tools

Return the RFC 9745 Deprecation signal for deprecated endpoints and link to replacement endpoints and migration docs where applicable. SDK release notes, type definitions, and examples should reference the same change ID.

Link changelog entries to API specifications, tests, docs, and the release pipeline. If endpoint behavior depends on configuration or region, record the condition so developers do not see an oversimplified headline.

5. Establish Writing and Review

Engineering submits a structured draft. Product confirms impact and action. Technical writing standardizes language. Security and legal review disclosure boundaries. Before release, check version, endpoints, dates, links, and migration steps.

When an error is found, retain the original entry and annotate revision time and impact; do not silently rewrite history. Assign an owner for major changes to follow customer migration and resulting issues.

6. Metrics and Experimentation

Track views, subscriptions, affected-customer reach, documentation clicks, migration starts and completions, error rate, and support hours. Connect reading to real new-version requests and successful business outcomes instead of treating page views as value.

Enable subscriptions and tenant impact view for one high-volume API, then compare incident rate, support hours, and migration cycle. Low reading with fewer tickets can still be valuable; more anxiety without action means categories and action links need work.

7. Roadmap and Exit Criteria

Phase one builds a structured template, public page, and controlled notice for additions and deprecations. Phase two adds version filters, RSS/webhooks, tenant impact analysis, and SDK linkage. Phase three offers history export, a change API, and automated migration tasks.

Pause expansion when entries cannot be reviewed in time, false alarms reduce trust, affected customers take no migration action, or maintenance exceeds support savings. Do not auto-publish changes without reliable evidence; keep human review.

Strong Sample Answer

I would validate whether customers lack a timeline, impact assessment, or critical notice, then launch a versioned public changelog. Entries separate additions, fixes, behavior changes, deprecations, security fixes, and breaking changes, with affected endpoints, action, date, migration link, and owner. Sensitive security content uses an authenticated channel.

Runtime Deprecation signals, documentation, SDKs, and the changelog share one change ID. I would pilot on a high-volume API and measure notice reach, migration completion, real new-version requests, incident rate, and support hours before adding subscriptions, impact analysis, or automated migration.

Common Mistakes

  • Treat the changelog as marketing news without impact and next action.
  • Show every customer the same content and leak tenant, vulnerability, or contract information.
  • Send email only and omit consistent runtime, documentation, and SDK signals.
  • Treat page views as migration success without validating real new-version requests.
  • Let engineering publish directly without product, technical-writing, security, and legal review.
  • Silently edit history so customers cannot reconstruct the original impact.
  • Add filters, subscriptions, and automation without exit criteria.

Follow-up Questions and Answers

Why publish publicly instead of sending email only?

A public record provides searchable, durable history; email and console deliver action reminders to affected customers. Both should use the same canonical entry.

Should security fixes be public too?

Decide by risk and disclosure window. Send high-risk detail through controlled channels; the public record can state necessary impact and fix status without helping reproduction.

How do you prove the changelog reduced problems?

Compare notice reach, migration completion, incident rate, support hours, and successful new-version requests rather than views alone. Use a before-and-after pilot on a high-volume API.

Who owns final publication?

Engineering supplies facts, product confirms impact and action, technical writing ensures clarity, and security and legal review disclosure. A single owner follows major-change outcomes.

What if customers need a machine-readable format?

Provide a stable JSON or RSS schema with change ID, version, level, affected scope, date, and migration link. Preserve field compatibility and record revisions.

When should investment stop?

Pause when maintenance exceeds support savings, false alarms damage trust, customers take no migration action, or review cannot keep pace. Fix data and process before adding automation.

Public sources

Related questions