dotCMS / dotCMS/core

[TASK] Regression Testing for Block Editor AI Features

Open
#34,075 0 comments 0 reactions 1 assignee View on GitHub

@DeanGonzalez is already working on this.

Since Jan 13, 2026.

dotCMS : AI Multiple Vendors
Dominant language
Java
Stars
970
Forks
486
Avg merge
3d 33m
Merged PRs (30d)
170

Description

Description

Complete regression testing of the AI-powered features in the Block Editor to ensure all AI content generation and image generation capabilities work as expected.

The Block Editor includes two AI-powered blocks that extend content creation capabilities:

  1. AI Content Block - Generates text-based content from user prompts
  2. AI Image Block - Creates images from text descriptions or existing field content

These blocks leverage the dotAI system and will only appear when dotAI is implemented (either as core feature or plugin).

Reference Documentation: https://dev.dotcms.com/docs/block-editor#AI


Acceptance Criteria

AI Block Availability
  • Verify AI Content Block appears when dotAI is implemented as core feature
  • Verify AI Image Block appears when dotAI is implemented as core feature
  • Verify AI Content Block appears when dotAI is implemented as plugin
  • Verify AI Image Block appears when dotAI is implemented as plugin
  • Confirm AI blocks do NOT appear when dotAI is not implemented
  • Test block visibility in different content types
  • Test block visibility for different user roles/permissions
AI Content Block - Dialog Functionality
  • Verify dialog opens correctly when AI Content Block is selected
  • Test text prompt input field accepts user input
  • Verify prompt field handles long text inputs
  • Test prompt field with special characters and multi-line input
  • Verify submit/generate button triggers content generation
  • Test cancel/close dialog functionality
AI Content Block - Content Generation
  • Verify AI generates content based on simple prompts
  • Test AI generation with complex/detailed prompts
  • Validate content appears in preview pane
  • Test content generation with various prompt types (questions, instructions, topics)
  • Verify generated content quality and relevance
  • Test generation with different content lengths requested
  • Verify loading/processing indicators during generation
  • Test error handling for failed generation requests
AI Content Block - Output & Integration
  • Verify generated content converts to standard paragraph blocks
  • Verify generated images (if any) convert to standard image blocks
  • Test insertion of generated content into the editor
  • Validate inserted blocks maintain proper formatting
  • Verify inserted blocks can be edited like standard blocks
  • Test undo/redo functionality with AI-generated content
  • Confirm output integrates seamlessly with existing content
AI Image Block - Dialog Functionality
  • Verify dialog opens correctly when AI Image Block is selected
  • Test custom text prompt input for image generation
  • Verify right-hand selector for using existing field content
  • Test switching between custom prompt and field content modes
  • Verify submit/generate button triggers image generation
  • Test cancel/close dialog functionality
AI Image Block - Image Generation
  • Test image generation from custom text prompts
  • Test image generation using existing field content
  • Verify generated image appears in preview pane
  • Validate image quality and relevance to prompt
  • Test generation with various image styles/descriptions
  • Test different image size/dimension options (if available)
  • Verify loading/processing indicators during generation
  • Test error handling for failed generation requests
AI Image Block - Output & Integration
  • Verify generated image converts to standard image block
  • Test insertion of generated image into the editor
  • Validate inserted image block properties (alt text, etc.)
  • Verify inserted image blocks can be edited/replaced
  • Test image block resizing and formatting options
  • Confirm output integrates seamlessly with existing blocks
  • Test undo/redo functionality with AI-generated images
User Experience & Workflow
  • Test complete workflow: open dialog → enter prompt → generate → review → insert
  • Verify intuitive UI/UX for both AI blocks
  • Test keyboard navigation and shortcuts
  • Verify accessibility compliance (ARIA labels, screen readers)
  • Test with different screen sizes and resolutions
  • Validate user feedback/messages during all operations
Edge Cases & Error Handling
  • Test with empty prompts
  • Test with very long prompts (token limits)
  • Test with prompts in different languages
  • Test with inappropriate/filtered content requests
  • Verify network timeout handling
  • Test with invalid API keys/configuration
  • Test concurrent AI generation requests
  • Verify proper error messages for all failure scenarios
Integration & Compatibility
  • Test with different Block Editor versions
  • Verify functionality across different content types
  • Test in different dotCMS page contexts
  • Verify browser compatibility (Chrome, Firefox, Safari, Edge)
  • Test mobile/tablet responsiveness
  • Validate performance with multiple AI blocks in same content
Rendering & Publishing
  • Verify AI-generated content renders correctly on frontend
  • Test published pages containing AI-generated blocks
  • Validate SEO metadata for AI-generated content
  • Test caching behavior with AI-generated content
  • Verify versioning/history tracking works correctly

Priority

High


Additional Context

  • Test Against: Custom version built from branch issue-32639-ai-dotai-portlet
  • Branch URL: https://github.com/dotCMS/core/tree/issue-32639-ai-dotai-portlet
  • Prerequisite: dotAI must be implemented (as core feature or plugin) for AI blocks to appear
  • Important: AI blocks output standard Block Editor blocks (paragraphs, images), not proprietary AI-specific formats
  • Related Documentation: https://dev.dotcms.com/docs/block-editor#AI
  • Related Feature: This testing depends on dotAI functionality (see issue #34072)
  • Test Environment: Should be tested in both dev and staging environments with proper dotAI configuration

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.