Skip to main content Skip to footer
HomeHome
 
  • Homepage
  • Searching for patents

    Patent knowledge

    Access our patent databases and search tools.

    Go to overview 

    • Overview
    • Technical information
      • Overview
      • Espacenet - patent search
      • European Publication Server
      • Searching Asian documents: patent search and monitoring services
      • EP full-text search
      • Bibliographic coverage in Espacenet and OPS
      • Full-text coverage in Espacenet and OPS
    • Legal information
      • Overview
      • European Patent Register
      • European Patent Bulletin
      • European Case Law Identifier sitemap
      • Searching Asian documents
      • Third-party observations
    • Business information
      • Overview
      • PATSTAT
      • IPscore
      • Patent insight reports
    • Data
      • Overview
      • Linked open EP data
      • Bulk data sets
      • Web services
      • Coverage, codes and statistics
    • Helpful resources
      • Overview
      • First time here?
      • Asian patent information
      • Patent information centres
      • Patent Translate
      • Patent Knowledge News
      • Business and statistics
      • Unitary Patent information in patent knowledge

    UP search

    Learn about the Unitary Patent in patent knowledge products and services

  • Applying for a patent

    Applying for a patent

    Practical information on filing and grant procedures.

    Go to overview 

    • Overview
    • European route
      • Overview
      • European Patent Guide
      • Oppositions
      • Oral proceedings
      • Appeals
      • Unitary Patent & Unified Patent Court
      • National validation
      • Request for extension/validation
    • International route (PCT)
      • Overview
      • Euro-PCT Guide – PCT procedure at the EPO
      • EPO decisions and notices
      • PCT provisions and resources
      • Extension/validation request
      • Reinforced partnership programme
      • Accelerating your PCT application
      • Patent Prosecution Highway (PPH)
      • Training and events
    • National route
    • MyEPO services
      • Overview
      • Understand our services
      • Get access
      • Find a professional representative
      • File with us
      • Interact on your files
      • Online Filing & fee payment outages
      • Tutorials
    • Forms
      • Overview
      • Request for examination
    • Fees
      • Overview
      • European fees (EPC)
      • International fees (PCT)
      • Unitary Patent fees (UP)
      • Fee payment and refunds
      • Warning

    UP

    Unitary Patent

  • Law & practice

    Law & practice

    European patent law, the Official Journal and other legal texts.

    Go to overview 

    • Overview
    • Legal texts
      • Overview
      • European Patent Convention
      • Official Journal
      • EPC Guidelines
      • PCT-EPO Guidelines
      • Guidelines revision cycle
      • Extension / validation system
      • London Agreement
      • National law relating to the EPC
      • Unitary patent system
      • National law relating to the UP
    • Court practices
      • Overview
      • European Patent Judges' Symposium
    • User consultations
      • Overview
      • Ongoing consultations
      • Completed consultations
    • Substantive patent law harmonisation
      • Overview
      • The Tegernsee process
      • Group B+
    • Convergence of practice
    • Options for professional representatives

    legal text

    Legal texts

  • News & events

    News & events

    Our latest news, podcasts and events, including the European Inventor Award.

    Go to overview 

     

    • Overview
    • News
    • Events
    • European Inventor Award
      • Overview
      • About the award
      • Categories and prizes
      • Meet the finalists
      • Nominations
      • Watch the 2022 ceremony
    • Press centre
      • Overview
      • Patent Index and statistics
      • Search in press centre
      • Background information
      • Copyright
      • Press contacts
      • Call back form
      • Email alert service
    • Innovation and patenting in focus
      • Overview
      • Firefighting technologies
      • Green tech in focus
      • CodeFest on Green Plastics
      • Clean energy technologies
      • IP and youth
      • Research institutes
      • Women inventors
      • Fighting coronavirus
      • Lifestyle
      • Space and satellites
      • The future of medicine
      • Materials science
      • Mobile communications
      • Biotechnology
      • Patent classification
      • Digital technologies
      • The future of manufacturing
      • Books by EPO experts
    • "Talk innovation" podcast

    Podcast

    Listen to our podcast

  • Learning

    Learning

    The e-Academy – the point of access to your learning

    Go to overview 

    • Overview
    • European Patent Academy
      • Overview
      • Learning activities
      • Learning paths
    • Professional hub
      • Overview
      • EQE - European qualifying examination
      • EPAC - European patent administration certification
    • Learning resources by area of interest
      • Overview
      • Patent granting
      • Technology transfer and dissemination
      • Patent enforcement and litigation
    • Learning resources by area by profile
      • Overview
      • Business and IP managers
      • EQE candidates
      • Judges, lawyers and prosecutors
      • National offices and IP authorities
      • Patent attorneys and paralegals
      • Universities, research centres and technology transfer centres (TTOs)

    European Patent Academy

    Boost your IP knowledge with (e-)training from the European Patent Academy

  • About us

    About us

    Find out more about our work, values, history and vision

    Go to overview 

    • Overview
    • The EPO at a glance
    • 50 years of the EPC
      • Overview
      • A glimpse of the planned activities
      • Kids’ collaborative art competition
      • 50 Leading Tech Voices
    • Legal foundations and member states
      • Overview
      • Legal foundations
      • Member states of the European Patent Organisation
      • Extension states
      • Validation states
    • Governance
      • Overview
      • Communiqués
      • Calendar
      • Select Committee documents
      • Administrative Council
    • Principles & strategy
      • Overview
      • Our mission, vision, values and corporate policy
      • Public consultation on the EPO's Strategic Plan 2028
      • Towards a New Normal
    • Leadership & management
      • Overview
      • President António Campinos
      • Management Advisory Committee
    • Social responsibility
      • Overview
      • Environment and sustainability
      • Art collection
    • Services & activities
      • Overview
      • Our services & structure
      • Consulting our users
      • European and international co-operation
      • European Patent Academy
      • Chief Economist
      • Ombuds Office
      • Reporting wrongdoing
    • Procurement
      • Overview
      • Procurement forecast
      • Doing business with the EPO
      • Procurement procedures
      • About eTendering and electronic signatures
      • Procurement portal
      • Invoicing
      • General conditions
      • Archived tenders
    • Transparency portal
      • Overview
      • General
      • Human
      • Environmental
      • Organisational
      • Social and relational
      • Economic
      • Governance
    • Statistics and trends
      • Overview
      • Statistics & Trends Centre
      • EPO Data Hub
      • Clarification on data sources
    • History
      • Overview
      • 1970s
      • 1980s
      • 1990s
      • 2000s
      • 2010s
      • 2020s

    about us

    Patent Index 2022

 
en de fr
  • Language selection
  • English
  • Deutsch
  • Français
Main navigation
  • Homepage
  • New to patents
    • Go back
    • Overview
    • What's your big idea?
    • Are you ready?
    • What to expect
    • How to apply for a patent
    • Your business and patents
    • Is it patentable?
    • Are you first?
    • Why do we have patents?
    • Patent quiz
    • Unitary patent video
  • Searching for patents
    • Go back
    • Overview
    • Technical information
      • Go back
      • Overview
      • Espacenet - patent search
        • Go back
        • Overview
        • National patent office databases
        • Global Patent Index (GPI)
        • Release notes
      • European Publication Server
        • Go back
        • Overview
        • Cross-reference index for Euro-PCT applications
        • EP authority file
        • Help
      • Searching Asian documents
      • EP full-text search
      • Bibliographic coverage in Espacenet and OPS
      • Full-text coverage in Espacenet
    • Legal information
      • Go back
      • Overview
      • European Patent Register
        • Go back
        • Overview
        • Release notes archive
        • Register documentation
          • Go back
          • Overview
          • Deep link data coverage
          • Federated Register
            • Go back
            • Overview
            • BG - Federated Register Service
            • GB - Federated Register Service
            • NL - Federated Register Service
            • MK - Federated Register Service
            • ES - Federated Register Service
            • GR - Federated Register Service
            • SK - Federated Register Service
            • FR - Federated Register Service
            • MT - Federated Register Service
          • Register events
      • European Patent Bulletin
        • Go back
        • Overview
        • Download Bulletin
        • EP Bulletin search
        • Help
      • European Case Law Identifier sitemap
      • Searching Asian documents
      • Third-party observations
    • Business information
      • Go back
      • Overview
      • PATSTAT
      • IPscore
        • Go back
        • Release notes
      • Patent insight reports
    • Data
      • Go back
      • Overview
      • Linked open EP data
      • Bulk data sets
        • Go back
        • Overview
        • Manuals
        • Sequence listings
        • National full-text data
        • European Patent Register data
        • EPO worldwide bibliographic data (DOCDB)
        • EP full-text data
        • EPO worldwide legal event data (INPADOC)
        • EP bibliographic data (EBD)
          • Go back
          • EBD files (weekly download) - free of charge
            • Go back
            • Secure EBD ST.36 files (weekly download) - for national patent offices only
        • Boards of Appeal decisions
        • EP full-text data for text analytics
      • Web services
        • Go back
        • Overview
        • Open Patent Services (OPS)
        • European Publication Server
      • Coverage, codes and statistics
        • Go back
        • Weekly updates
        • Updated regularly
    • Helpful resources
      • Go back
      • Overview
      • First time here? Patent information explained.
        • Go back
        • Overview
        • Basic definitions
        • Patent classification
          • Go back
          • Overview
          • Cooperative Patent Classification (CPC)
        • Patent families
          • Go back
          • Overview
          • DOCDB simple patent family
          • INPADOC extended patent family
        • Legal event data
          • Go back
          • Overview
          • INPADOC classification scheme
      • Asian patent information
        • Go back
        • Overview
        • China (CN)
          • Go back
          • Overview
          • Facts and figures
          • Grant procedure
          • Numbering system
          • Useful terms
          • Searching in databases
        • Chinese Taipei (TW)
          • Go back
          • Overview
          • Grant procedure
          • Numbering system
          • Useful terms
          • Searching in databases
        • India (IN)
          • Go back
          • Overview
          • Facts and figures
          • Grant procedure
          • Numbering system
        • Japan (JP)
          • Go back
          • Overview
          • Facts and figures
          • Grant procedure
          • Numbering system
          • Useful terms
          • Searching in databases
        • Korea (KR)
          • Go back
          • Overview
          • Facts and figures
          • Grant procedure
          • Numbering system
          • Useful terms
          • Searching in databases
        • Russian Federation (RU)
          • Go back
          • Overview
          • Facts and figures
          • Numbering system
          • Searching in databases
        • Useful links
      • Patent information centres (PATLIB)
      • Patent Translate
      • Patent Knowledge News
      • Business and statistics
      • Unitary Patent information in patent knowledge
  • Applying for a patent
    • Go back
    • Overview
    • European route
      • Go back
      • Overview
      • European Patent Guide
      • Oppositions
      • Oral proceedings
        • Go back
        • Oral proceedings calendar
          • Go back
          • Calendar
          • Public access to appeal proceedings
          • Public access to opposition proceedings
          • Technical guidelines
      • Appeals
      • Unitary Patent & Unified Patent Court
        • Go back
        • Overview
        • Unitary Patent
          • Go back
          • Overview
          • Legal framework
          • Unitary Patent Guide
          • Main features
          • Applying for a Unitary Patent
          • Cost of a Unitary Patent
          • Translation and compensation
          • Start date
        • Unified Patent Court
      • National validation
      • Extension/validation request
    • International route
      • Go back
      • Overview
      • Euro-PCT Guide
      • Entry into the European phase
      • Decisions and notices
      • PCT provisions and resources
      • Extension/validation request
      • Reinforced partnership programme
      • Accelerating your PCT application
      • Patent Prosecution Highway (PPH)
        • Go back
        • Patent Prosecution Highway (PPH) programme outline
      • Training and events
    • National route
    • MyEPO services
      • Go back
      • Overview
      • Understand our services
        • Go back
        • Overview
        • Online Filing 2.0 pilot
        • MyEPO Portfolio - pilot phase
        • Online Filing 2.0 pilot continuation
        • Exchange data with us using an API
      • Get access
        • Go back
        • Overview
        • Installation and activation
      • Find a professional representative
      • File with us
        • Go back
        • Overview
        • What if our online filing services are down?
        • Release notes
      • Interact on your files
      • Online Filing & fee payment outages
      • Tutorials
    • Fees
      • Go back
      • Overview
      • European fees (EPC)
        • Go back
        • Overview
        • Decisions and notices
      • International fees (PCT)
        • Go back
        • Reduction in fees
        • Fees for international applications
        • Decisions and notices
        • Overview
      • Unitary Patent fees (UP)
        • Go back
        • Overview
        • Decisions and notices
      • Fee payment and refunds
        • Go back
        • Overview
        • Payment methods
        • Getting started
        • FAQs and other documentation
        • Technical information for batch payments
        • Decisions and notices
        • Release notes
      • Warning
    • Forms
      • Go back
      • Request for examination
  • Law & practice
    • Go back
    • Overview
    • Legal texts
      • Go back
      • Overview
      • European Patent Convention
        • Go back
        • Overview
        • Archive
          • Go back
          • Overview
          • Documentation on the EPC revision 2000
            • Go back
            • Overview
            • Diplomatic Conference for the revision of the EPC
            • Travaux préparatoires
            • New text
            • Transitional provisions
            • Implementing regulations to the EPC 2000
            • Rules relating to Fees
            • Ratifications and accessions
          • Travaux Préparatoires EPC 1973
      • Official Journal
      • EPC Guidelines
        • Go back
        • Overview
        • Archive
      • PCT-EPO Guidelines
        • Go back
        • Overview
        • Archive
      • Guidelines revision cycle
      • Extension / validation system
      • London Agreement
      • National law relating to the EPC
        • Go back
        • Overview
        • Archive
      • Unitary Patent system
      • National measures relating to the Unitary Patent 
    • Court practices
      • Go back
      • Overview
      • European Patent Judges' Symposium
    • User consultations
      • Go back
      • Overview
      • Ongoing consultations
      • Completed consultations
    • Substantive patent law harmonisation
      • Go back
      • Overview
      • The Tegernsee process
      • Group B+
    • Convergence of practice
    • Options for professional representatives
  • News & events
    • Go back
    • Overview
    • News
    • Events
    • European Inventor Award
      • Go back
      • Overview
      • About the award
      • Categories and prizes
      • Meet the finalists
      • Nominations
      • Watch the 2023 ceremony
      • European Inventor Network
        • Go back
        • Activities granted in 2023
    • Press centre
      • Go back
      • Overview
      • Patent Index and statistics
      • Search in press centre
      • Background information
        • Go back
        • Overview
        • European Patent Office
        • Q&A on patents related to coronavirus
        • Q&A on plant patents
      • Copyright
      • Press contacts
      • Call back form
      • Email alert service
    • In focus
      • Go back
      • Overview
      • Firefighting technologies
        • Go back
        • Overview
        • Detection and prevention of fires
        • Fire extinguishing
        • Protective equipment
        • Post-fire restoration
      • Green tech in focus
        • Go back
        • Overview
        • About green tech
        • Renewable energies
        • Energy transition technologies
        • Building a greener future
      • CodeFest on Green Plastics
      • Clean energy technologies
        • Go back
        • Overview
        • Renewable energy
        • Carbon-intensive industries
        • Energy storage and other enabling technologies
      • IP and youth
      • Research institutes
      • Women inventors
      • Fighting coronavirus
        • Go back
        • Overview
        • Vaccines and therapeutics
          • Go back
          • Overview
          • Vaccines
          • Overview of candidate therapies for COVID-19
          • Candidate antiviral and symptomatic therapeutics
          • Nucleic acids and antibodies to fight coronavirus
        • Diagnostics and analytics
          • Go back
          • Overview
          • Protein and nucleic acid assays
          • Analytical protocols
        • Informatics
          • Go back
          • Overview
          • Bioinformatics
          • Healthcare informatics
        • Technologies for the new normal
          • Go back
          • Overview
          • Devices, materials and equipment
          • Procedures, actions and activities
          • Digital technologies
        • Inventors against coronavirus
      • Lifestyle
      • Space and satellites
        • Go back
        • Overview
        • Patents and space technologies
      • Healthcare
        • Go back
        • Overview
        • Medical technologies and cancer
        • Personalised medicine
      • Materials science
        • Go back
        • Overview
        • Nanotechnology
      • Mobile communications
      • Biotechnology
        • Go back
        • Overview
        • Red, white or green
        • The role of the EPO
        • What is patentable?
        • Biotech inventors
      • Classification
        • Go back
        • Overview
        • Nanotechnology
        • Climate change mitigation technologies
          • Go back
          • Overview
          • External partners
          • Updates on Y02 and Y04S
      • Digital technologies
        • Go back
        • Overview
        • About ICT
        • Hardware and software
        • Patents and standards
        • Artificial intelligence
        • Fourth Industrial Revolution
      • Additive manufacturing
        • Go back
        • Overview
        • About AM
        • AM innovation
      • Books by EPO experts
    • Podcast
  • Learning
    • Go back
    • Overview
    • European Patent Academy
      • Go back
      • Overview
      • Learning activities
      • Learning Paths
    • Professional hub
      • Go back
      • Overview
      • EPAC - European patent administration certification
      • EQE - European Qualifying Examination
        • Go back
        • Overview
        • Archive
        • Candidates successful in the European qualifying examination
        • Compendium
          • Go back
          • Overview
          • Pre-examination
          • Paper A
          • Paper B
          • Paper C
          • Paper D
    • Learning resources by area of interest
      • Go back
      • Overview
      • Patent granting
      • Technology transfer and dissemination
      • Patent enforcement and litigation
        • Go back
        • Overview
        • Patent enforcement in Europe
        • Patent litigation in Europe
    • Learning resources by profile
      • Go back
      • Overview
      • Business and IP managers
        • Go back
        • Overview
        • Innovation case studies
          • Go back
          • Overview
          • SME case studies
          • Technology transfer case studies
          • High-growth technology case studies
        • Inventors' handbook
          • Go back
          • Overview
          • Introduction
          • Disclosure and confidentiality
          • Novelty and prior art
            • Go back
            • Overview
            • Is the idea ‘obvious’?
            • Prior art searching
            • Professional patent searching
            • Simple Espacenet searching
            • What is prior art?
            • Why is novelty important?
          • Competition and market potential
            • Go back
            • Overview
            • Research guidelines
          • Assessing the risk ahead
            • Go back
            • Overview
            • Exploitation routes
            • Significant commercial potential
            • Significant novelty
            • What about you?
            • What if your idea is not novel but does have commercial potential?
          • Proving the invention
            • Go back
            • Overview
            • Help with design or redesign
            • Prototype strategy
          • Protecting your idea
            • Go back
            • Overview
            • Forms of IPR
            • Patenting strategy
            • The patenting process
          • Building a team and seeking funding
            • Go back
            • Overview
            • Building a team
            • Sources of funding
            • Sources of help for invention
          • Business planning
            • Go back
            • Overview
            • Constructing a business plan
            • Keep it short!
          • Finding and approaching companies
            • Go back
            • Overview
            • First contact
            • Meetings
          • Dealing with companies
            • Go back
            • Overview
            • Advance or guaranteed payment
            • Companies and your prototype
            • Full agreement – and beyond
            • Negotiating a licensing agreement
            • Reaching agreement
            • Royalties
        • Best of search matters
          • Go back
          • Overview
          • Tools and databases
          • EPO procedures and initiatives
          • Search strategies
          • Challenges and specific topics
        • Support for high-growth technology businesses
          • Go back
          • Overview
          • For IP professionals
          • For business decision-makers
          • For stakeholders of the innovation ecosystem
        • IP clinics
      • EQE Candidates
        • Go back
        • Overview
        • Coffee-break questions
        • Daily D questions
        • European qualifying examination - Guide for preparation
      • Judges, lawyers and prosecutors
        • Go back
        • Overview
        • Compulsory licensing in Europe
        • The jurisdiction of European courts in patent disputes
      • National offices and IP authorities
        • Go back
        • Overview
        • Learning material for examiners of national officers
        • Learning material for formalities officers and paralegals
      • Patent attorneys and paralegals
      • Universities, research centres and TTOs
        • Go back
        • Overview
        • Academic Research Programme
          • Go back
          • Overview
          • Completed research projects
          • Current research projects
        • Pan-European Seal Young Professionals Programme
          • Go back
          • Overview
          • For students
          • For universities
            • Go back
            • Overview
            • IP education resources
            • University memberships
          • Our young professionals
          • Professional development plan
        • IP Teaching Kit
          • Go back
          • Overview
          • Download modules
        • Intellectual property course design manual
  • About us
    • Go back
    • Overview
    • The EPO at a glance
    • 50 years of the EPC
      • Go back
      • Overview
      • 50 Leading Tech Voices
      • Kids’ collaborative art competition
    • Legal foundations and member states
      • Go back
      • Overview
      • Legal foundations
      • Member states
        • Go back
        • Overview
        • Member states by date of accession
      • Extension states
      • Validation states
    • Governance
      • Go back
      • Overview
      • Communiqués
        • Go back
        • Overview
        • 2022
        • 2021
        • 2020
        • 2019
        • 2018
        • 2017
        • 2016
        • 2015
        • 2014
        • 2013
      • Calendar
      • Documents and publications
        • Go back
        • Overview
        • Select Committee documents
      • Administrative Council
        • Go back
        • Overview
        • Composition
        • Representatives
        • Rules of Procedure
        • Board of Auditors
        • Secretariat
        • Council bodies
    • Principles & strategy
      • Go back
      • Overview
      • Mission, vision, values & corporate policy
      • Strategic Plan 2028
      • Towards a New Normal
      • Data protection & privacy notice
    • Leadership & management
      • Go back
      • Overview
      • About the President
      • Management Advisory Committee
    • Procurement
      • Go back
      • Overview
      • Procurement forecast
      • Doing business with the EPO
      • Procurement procedures
      • About eTendering
      • Procurement portal
        • Go back
        • Overview
        • e-Signing contracts
      • Invoicing
      • General conditions
      • Archived tenders
    • Services & activities
      • Go back
      • Overview
      • Our services & structure
      • Quality
        • Go back
        • Overview
        • Foundations
          • Go back
          • Overview
          • European Patent Convention
          • Guidelines for examination
          • Our staff
        • Enabling quality
          • Go back
          • Overview
          • Prior art
          • Classification
          • Tools
          • Processes
        • Products & services
          • Go back
          • Overview
          • Search
          • Examination
          • Opposition
          • Continuous improvement
        • Quality through networking
          • Go back
          • Overview
          • User engagement
          • Co-operation
          • User satisfaction survey
          • Stakeholder Quality Assurance Panels
        • Patent Quality Charter
        • Statistics
          • Go back
          • Overview
          • Search
          • Examination
          • Opposition
      • Consulting our users
        • Go back
        • Overview
        • Standing Advisory Committee before the EPO (SACEPO)
          • Go back
          • Overview
          • Objectives
          • SACEPO and its working parties
          • Meetings
          • Single Access Portal – SACEPO Area
      • Our user service charter
      • European and international co-operation
        • Go back
        • Overview
        • Co-operation with member states
          • Go back
          • Overview
        • Bilateral co-operation with non-member states
          • Go back
          • Overview
          • Validation system
          • Reinforced Partnership programme
        • Multilateral international co-operation with IP offices and organisations
        • Co-operation with international organisations outside the IP system
      • European Patent Academy
        • Go back
        • Overview
        • Partners
      • Chief Economist
        • Go back
        • Overview
        • Economic studies
      • Ombuds Office
      • Reporting wrongdoing
    • Statistics and trends
      • Go back
      • Overview
      • Statistics & Trends Centre
      • EPO Data Hub
      • Clarification on data sources
    • Social responsibility
      • Go back
      • Overview
      • Environment
      • Art collection
        • Go back
        • Overview
        • The collection
        • Let's talk about art
        • Artists
        • Media library
        • What's on
        • Publications
        • Contact
    • History
      • Go back
      • Overview
      • 1970s
      • 1980s
      • 1990s
      • 2000s
      • 2010s
      • 2020s
    • Transparency portal
      • Go back
      • Overview
      • General
        • Go back
        • Overview
        • Annual Review 2022
          • Go back
          • Overview
          • Foreword
          • Executive summary
          • Goal 1: Engaged and empowered
          • Goal 2: Digital transformation
          • Goal 3: Master quality
          • Goal 4: Partner for positive impact
          • Goal 5: Secure sustainability
      • Human
      • Environmental
      • Organisational
      • Social and relational
      • Economic
      • Governance
  • Boards of Appeal
    • Go back
    • Overview
    • Decisions of the Boards of Appeal
      • Go back
      • Overview
      • Recent decisions
      • Selected decisions
    • Procedure
    • Annual reports
      • Go back
      • Overview
    • Organisation
      • Go back
      • Overview
      • President of the Boards of Appeal
      • Enlarged Board of Appeal
        • Go back
        • Overview
        • Pending referrals (Art. 112 EPC)
        • Decisions sorted by number (Art. 112 EPC)
        • Pending petitions for review (Art. 112a EPC)
        • Decisions on petitions for review (Art. 112a EPC)
      • Technical Boards of Appeal
      • Legal Board of Appeal
      • Disciplinary Board of Appeal
      • Presidium
        • Go back
        • Overview
        • Composition of the Presidium
          • Go back
          • Overview
          • Archive
    • Code of Conduct
    • Business distribution scheme
      • Go back
      • Overview
      • Technical boards of appeal by IPC in 2023
      • Archive
    • Annual list of cases
    • Communications
    • Publications
    • Case Law of the Boards of Appeal
      • Go back
      • Overview
      • Archive
    • Case Law from the Contracting States to the EPC
    • Oral proceedings
  • Service & support
    • Go back
    • Overview
    • Website updates
    • Availability of online services
      • Go back
      • Overview
    • FAQ
      • Go back
      • Overview
    • Publications
    • Ordering
      • Go back
      • Overview
      • Terms and conditions
        • Go back
        • Overview
        • Patent information products
        • Bulk data sets
        • Open Patent Services (OPS)
        • Fair use charter
    • Procedural communications
    • Useful links
      • Go back
      • Overview
      • Patent offices of member states
      • Other patent offices
      • Legal resources
      • Directories of patent attorneys
      • Patent databases, registers and gazettes
      • Disclaimer
    • Contact us
      • Go back
      • Overview
      • Filing options
      • Locations
      • Specific contact
      • Surveys
        • Go back
        • Overview
        • Search services
        • Examination services, final actions and publication
        • Opposition services
        • Patent filings
          • Go back
          • Overview
          • Detailed methodology
          • Archive
        • Online Services
        • Patent information
          • Go back
          • Overview
          • Innovation process survey
        • Customer services
        • Filing services
        • Website
        • Survey on electronic invoicing
        • Companies innovating in clean and sustainable technologies
    • Subscription centre
      • Go back
      • Overview
      • Subscribe
      • Change preferences
      • Unsubscribe
    • Official holidays
    • Forums
    • Glossary
Board of Appeals
Decisions

Recent decisions

Overview
  • 2023 decisions
  • 2022 decisions
  • 2021 decisions
https://www.epo.org/en/node/t152087eu1
  1. Home
  2. T 2087/15 21-07-2020
Facebook Twitter Linkedin Email

T 2087/15 21-07-2020

European Case Law Identifier
ECLI:EP:BA:2020:T208715.20200721
Date of decision
21 July 2020
Case number
T 2087/15
Petition for review of
-
Application number
07834775.4
IPC class
G09B7/00
Language of proceedings
EN
Distribution
NO DISTRIBUTION (D)

Download and more information:

Decision in EN 434.74 KB
Documentation of the appeal procedure can be found in the European Patent Register
Bibliographic information is available in:
EN
Versions
Unpublished
Application title

SYSTEM AND METHOD FOR IMPROVING THE QUALITY OF COMPUTER GENERATED EXAMS

Applicant name
Reliant Exams AS
Opponent name
-
Board
3.4.03
Headnote
-
Relevant legal provisions
European Patent Convention Art 56
Rules of procedure of the Boards of Appeal Art 12(8)
Keywords

Inventive step - claim 8 of sole request (no)

Inventive step - mixture of technical and non-technical features

Catchword
-
Cited decisions
T 0641/00
T 0172/03
T 0258/03
T 1543/06
Citing decisions
-

I. The appeal is against the decision of the examining division refusing the European patent application No. 07 834 775.4 on the the ground of lack of inventive step within the meaning of Article 56 EPC 1973.

II. In a communication, the Board indicated its provisional opinion that the claimed invention lacked an inventive step. With its response dated 21 April 2020, the appellant filed a amended set of claims.

III. The appellant requests that the decision under appeal be set aside and a European patent be granted based on its request filed on 21 April 2020.

IV. Claims 1 and 8 according to the sole request correspond in substance to claims 1 and 8 underlying the impugned decision, except for minor amendments of editorial nature made in claim 1 (see below, emphasis added by the Board).

Claim 1 is worded as follows:

System for generating exams, questionnaires or similar skill-level exams administered in large numbers, including a set of questions to be answered,

the system comprising a data base including a number of questions in at least one topic, each question being associated with a data set related to answers given to the questions in previous uses of the questions in question sets presented to at least one exam candidate, the database also comprising statistical data related to calculated facility, selectivity and distribution for said questions based on said previous answers, representing a measure of the quality of a set of questions,

said database is stored on at least one data storage device,

the system further comprising computer-based selection means for randomly selecting a question within one or more predetermined topics from said data base,

and a computer-based evaluation means for evaluating for possible inclusion in a question set for presentation to exam candidates the selected questions relative to predetermined requirements to the selected questions and said measure of the quality of said question[deleted: s] set,

and discarding from possible inclusion questions not fulfilling said requirements thereby to generate from said database a question set for presentation to exam candidates, wherein selected questions that do not fit a chosen chosen [sic] measure regarding selectivity and facility are rejected from the new question set, such that a controlled distribution of difficulty is obtained

wherein the evaluation means, based on said measures is adapted to reject selected questions not fulfilling the predetermined requirements by fitting a number of correct answers per failure in the selected questions with predetermined distributions, so as to ensure the controlled distribution of difficulty in the new question set; and

wherein the evaluation means is further adapted to indicate a quality of the new question set by comparing an actual reliability of the new question set in use to a calculated reliability, assuming the new question set to have a same distribution of characteristics as a known set of [deleted: of] the questions having known reliability.

Claim 8 has the following wording:

Method for generating exams, questionnaires or similar skill-level tests administered in large numbers, the method comprising the steps of:

• storing a number of questions in at least one topic a data base on [sic], each question being associated with a data set related to answers given to the questions in previous exams, said database being stored on at least one data storage device,

• randomly selecting by computer-based means a question within one or more predetermined topics from said data base,

• evaluating by computer-based evaluation means the selected questions relative to predetermined requirements related to a measure based on facility, selectivity and distribution corresponding to said data set for possible inclusion in a question set for presentation to exam candidates and discarding questions not fulfilling said requirements thereby generating a question set for presentation to exam candidates.

V. The appellant's arguments provided in the statement of grounds of appeal can be summarised as follows:

The position of the examining division that the effect of the invention was not an objective technical problem, but only took place in the mind of students facing difficult questions was not correct, because the invention took into account the correlation with answers to other questions to improve the quality of each question. Neither the question generation nor the answers were per se part of the invention. The invention used both questions and answers to improve a generated exam allowing some questions to be removed from the set based on the analysis, leaving only good performing questions to be used for new tests and exams. This was obtained by analysing the relationship between the questions and the provided answers, and not by considering whether or nor the answers were correct.

1. The appeal is admissible.

2. Procedural matters

In a communication pursuant to Rule 100(2) EPC, the Board informed the appellant about its provisional opinion that claims 1 and 8 lacked an inventive step (Article 56 EPC 1973).

In its reply dated 21 April 2020, the appellant provided further arguments and filed a set of claims 1 - 14 corresponding substantively to the set of claims underlying the contested decision, with the exception of minor amendments of editorial nature made to claim 1. The appellant further referred to a "discussion of the communication of the Board of Appeal from the inventor" and submitted a document containing arguments from one of the inventors as an annex to its letter.

Oral proceedings were not requested.

In accordance with Article 12(8) RPBA 2020, the Board concluded that the case was ready for decision.

3. The invention

The present invention relates to a method and system for improving the quality of computer generated sets of examination questions utilizing empirical data of question items from previous exams. The data are stored in a data base of a data storage device and can include e.g. facility/difficulty, selectivity, distribution of answers (page 5, lines 7 - 9), the correlation between the quality of the answers given to the question and the quality of the rest of the exam given by a person (page 4, lines 7 - 12), the deviation in the responses given to the question (page 4, lines 12 - 14), or other criteria (page 4, lines 16 - 17). The method comprises a step of selecting a random question from the database and evaluating the selected question based on predetermined requirements for the possible inclusion in a question set (e.g. an exam or a questionnaire) for presentation to exam candidates. Questions found not fulfilling the requirements are discarded so that a question set of better quality is obtained. The steps of storing data, selecting, evaluating and possibly discarding question items are performed by computer-based means (see page 7, lines 26 - 27).

4. Independent method claim 8

4.1 The scope of method claim 8 is broader than the method implemented on the system according to claim 1, because the method according to claim 8 lacks inter alia a step of indicating "a quality of the new question set by comparing an actual reliability of the new question set in use to a calculated reliability, assuming ..." according to claim 1, last four lines.

Therefore, the Board focuses on method claim 8.

4.2 The Board considers the technical features of claim 8 to be a "data storage device", a "data base stored on the data storage device", "computer-based means", "computer-based evaluation means". In other words, the technical features of claim 8 correspond to a standard computer having a memory ("data storage device") and a processor ("computer-based means", "computer based evaluation means").

While the Board accepts that claim 8, being a method involving technical means, has an overall technical character (see e.g. T 258/03, Headnote I), it comprises a mixture of technical and non-technical features.

4.3 According to the method of claim 8, it is the aim of the present invention to generate exams, questionnaires or similar skill-level tests administered in large numbers, by:

a) randomly selecting a question within one or more predetermined topics from a number of existing questions in at least one topic, each question of said number of existing questions being associated with a data set related to answers given to the questions in previous exams,

b) evaluating the selected questions relative to predetermined requirements related to a measure based on facility, selectivity and distribution corresponding to said data set for possible inclusion in a question set for presentation to exam candidates and

c) discarding questions not fulfilling said requirements thereby generating a question set for presentation to exam candidates.

The Board is of the opinion that steps a) to c) are well-known tasks of people preparing exams (e.g. teachers) who for centuries have performed this task mentally or on paper. A school teacher or an instructor preparing an exam e.g. for driving test candidates or for pilots selects question items from a pool of existing questions used in previous tests and evaluates these items with respect to their facility (i.e. how well or badly the question was answered in previous exams), selectivity (i.e. how representative the question is for the ability the exam aims to test) or distribution (i.e. how the scores in previous exams were distributed among the different candidates). If they find the selected and evaluated question unsuitable for the test (e.g. because it was too easy or too difficult for the average candidate in previous tests or because it revealed being erroneous or unclear), they will discard this particular question and not include it into the test they are preparing. However, if they find the question item suitable for the test, they will consider its inclusion in the test.

It follows that steps a) to c) for adapting questions to the level of students are not related to solving a technical problem, but to the non-technical task of a test writer (e.g. a teacher).

Even when characterised quantitatively, the effects underlying the claimed selection criteria are non-technical effects, merely possibly taking place in the minds of students facing easy or difficult questions, as they might face a test which corresponds more or less to their individual intellectual abilities. The same effects are expected to be achieved by the question sets resulting from the above mentioned steps a) to c).

The appellant provided arguments with respect to the technical/non-technical features of claim 8, which have not convinced the Board for the reasons as follows:

4.3.1 The Board is of the opinion that the appellant's argument that the invention took into account the correlation with answers to other questions to improve the quality of each question - see statement of grounds of appeal, page 1, third and fourth paragraphs - is not relevant, because in the method according to claim 8 a step of evaluating the "correlation" of a given question item with answers to other questions is not a part of the claimed method. This appears to be confirmed by the appellant's statement in the annex to the letter dated 21 April 2020, page 9, first paragraph.

Even if the Board were to accept that the invention took into account the correlation with answers to other questions to improve the quality of each question, the effect of this feature is not of technical nature, but would only improve a teaching method or competence screening, which is equivalent to an improvement of a non-technical activities, essentially being based on mental acts.

4.3.2 The Board does not share the appellant's view that "the present invention would work without human interaction" so that it "does not necessitate that any part would be performed in the mind of a student, even if this is the preferred use", see the statement of grounds of appeal, page 1, last paragraph, page 2, first paragraph. The method according to claim 8 uses a data base comprising data sets "related to answers given to the questions in previous exams" and aims at "generating a question set for presentation to exam candidates". A skilled person understands that the term "previous exams" does not relate to exam performed by a computer, but by human candidates so that the data sets are the result of human interaction, namely the performance of human test candidates in past exams. Moreover, the skilled person understands that the questions sets generated are to be presented to human exam candidates so that it can reasonably be argued that those effects provided by steps a) to c) which are actually sought to be achieved by the invention and in the end might provide an objectively measurable difference over prior art question sets - i.e. that the question sets generated perform better than previous question sets - might possibly take place in the minds of these candidates.

4.3.3 The argument of the appellant that the questions were not generated by a machine, see statement of grounds of appeal, page 2, first and second paragraph, is not relevant, because neither the examining division in their decision nor the Board understand the invention in a way that the question items themselves inevitably would be machine generated, and there is no indication in the application as filed that this would be the case.

4.3.4 The appellant pointed out that the invention did not relate to the generation of individual questions, but how it handled existing questions, "which may or may not have been used in previous exams".

The Board shares this view insofar the claimed method is not related to the generation of questions or answers, but to the generation of a set of questions for future presentation to exam candidates. It is clear to the Board that the origin of the questions themselves is left open, and the questions may obviously be human generated (but in theory also computer generated). The Board however observes that claim 8 is limited to questions that have been used in previous exams, because according to claim 8, steps a) to c) concern questions having a data set in the data base so that they necessarily have been presented in previous exams.

4.3.5 In the statement annexed to the letter dated 21 April 2020, page 2, part B), the appellant argued that the invention "consistently" improved "the quality of a question data base, and hence the quality of questionnaires produced from that" in the case of multiple choice question (MCQ) exams. In part C) on page 2 of the same statement, the appellant questioned if steps a) to c) had been performed by teachers for "centuries". The appellant also stated that the invention did "not aim to improve the content quality of each question".

The Board is not convinced by these arguments, because claim 8 neither comprises any means for improving the quality of the database nor is it limited to MCQ exams. However, even if the Board were to accept that the quality of the questions in a data base would improve, this cannot be qualified as a technical effect. The Board is of the opinion that steps a) to c) are performed by a person preparing an exam with questions to be presented to candidates. These type of exams existed well before the priority date of the present application, e.g. for the Chinese imperial examinations (606 - 1905). Hence, the Board agrees with the appellant that the claimed method does not change an individual question (i.e. does not improve its quality), but aim at providing an improved set of questions for an exam.

4.3.6 The appellant stated in the last paragraph of the statements of grounds of appeal that the technical character of the invention would be "related both to the objectivity and efficiency of the system as well as the fact that a manual operation handled by humans simply is not possible". The question sets were produced as a data selection resulting from statistical analysis of the registered responses to the questions. In the statement annexed to the letter dated 21 April 2020, page 2, part A), the appellant also argued that the invention was "completely separated from the subjectivity and illusiveness of what goes on in the mind of students and teachers". On page 3 of the same statement, the appellant argued that the invention is not an integrated part of the so-called "teaching sphere".

The Board is not convinced by these arguments, because claim 8 is not limited to a "large amount of input" difficult to handle by a human operator (e.g. a teacher). It might be correct that a test writer would have difficulties to mentally handle fifty thousand questions. In the Board's view there would be no problem to handle an ensemble of e.g. fifty questions known to the test writer and used in previous tests. As claim 8 does not specify the number of questions from previous exams in the data base, the method involving steps a) to c) on a computer is not necessarily more efficient. Furthermore, if the decision of including or discarding is based e.g. on the difficulty of the selected question (i.e. the number of correct answers compared to the number of total answers), it is not plausible that the method implemented on a computer would be necessarily more objective (or less subjective) than the same method performed by a human. Moreover, claim 8 does neither exclude any additional "manual operation" by a human being, nor does it require any statistical analysis, "sound mathematics and statistical procedures" or "special statistical arrangements" as argued in the statement annexed to the letter dated 21 April 2020. In other words, the Board is not convinced that the claimed method is necessarily performed more efficiently and/or less subjectively by computer-based means, compared to a human test writer. Finally, the Board cannot agree that the steps a) to c) could not be a part of what the appellant calls "teaching sphere", because the function of exams e.g. provided by a teacher to his students is to evaluate if his teaching was successful. Hence, it cannot be said that steps a) to c) are outside the "teaching sphere".

4.4 Therefore, the Board shares the view of the examining division that the technical features of the independent method claim 8 are not more than a computer having a data storage device (i.e. a memory) for storing a data base and a processor for implementing a method involving non-technical method steps a), b) and c) on this computer.

4.5 It is established case law that non-technical features cannot contribute to inventive step. Therefore, non-technical features may legitimately be part of the problem to be solved (T 641/00), for example in the form of a requirement specification given to the skilled person to implement, see Case Law of the Boards of appeal, 9th edition, 2019, I.D.9.1.4.

Thus, the sole technical problem derivable from the wording of claim 8 would be the proper configuration and programming of known technical means (i.e. a computer having a data storage device) in order to implement non-technical (teaching) constraints, i.e. the method steps a) to c).

The objective technical problem to be solved would thus be formulated as how the skilled person (a software programmer expert) would implement steps a) to c) of section 4.3 above in a standard computer.

The appellant provided arguments with respect to the objective technical problem and the relevant skilled person, which have not convinced the Board for the reasons as follows:

4.5.1 The appellant argued in its letter dated 21 April 2020 that the relevant person skilled in the art was not a "programmer", but a "person who aims at making as objective exams as possible without relying on the input from the lecturer from the moment the question has been made". A programmer "would neither be aware of the problem nor knew about the possibility to provide and use the information about the question set". The Board may accept this argument concerning the skilled person, however it appears questionable if the skilled person defined by the appellant is inevitably a technically skilled person, apart from the fact that it does not appear to correspond to any usual professional. It still mostly appear to correspond to a teacher in general, and therefore his contribution to the problem solved is to be taken as being given for the purposes of the problem-solution approach, as explained above in point 4.5.

It is well established case law, that the person skilled in the art in the case of computer-implemented inventions is an expert in a technical field, see Case Law of the Boards of Appeal, 9th edition, 2019, I.D.8.1.4. For example, if the technical problem concerns a computer implementation of a business, actuarial or accountancy system, it will be a person skilled in data processing, and not merely a businessman, actuary or accountant (T 172/03). In the present case, the objective technical problem lies in the implementation of a non-technical method on a computer so that the skilled person is a computer engineer, and not a person specialized in creating exams (e.g. a teacher). As explained in section 4.5 above, the computer engineer would have steps a) to c) as requirement specifications given to implement on a standard computer.

4.5.2 The appellant argued in the letter dated 21 April 2020 that the neither a programmer nor a teacher would perform step b) as the teacher would rely on his understanding of the field and how to make and respond to the individual questions. They would not take into account the "statistical information about the question sets" and reject a question "based on the statistics". The appellant stated that no proof was provided that the teacher would apply statistical methods.

The Board notes that claim 8 does not include any step of performing a statistical analysis to decide whether to reject a selected question or not. No statistical method is mentioned. Claim 8 only requires an evaluation of the selected question based on e.g. its difficulty. In the Boards view, a test writer (e.g. a teacher) would take into account the difficulty of a selected question based on the answers in previous exams before deciding to include it into a question set to be presented in a future exam. Hence, a programmer would be provided with a method including also step b) as requirement specification.

4.5.3 It may be understandable that this settled approach of the case law - namely that the fictional skilled person is already given elements of the inventive solution - may appear as obviously wrong in view of the present invention. However, as explained in T 1543/06, Reasons 2.6, the fiction of using an artificial (or hidden) starting point must be accepted as "an artefact of the systematic use of the problem-solution approach for assessing inventive step" for inventions involving both excluded and non-excluded subject-matter.

4.5.4 In his letter dated 21 April 2020 the appellant discusses the possibility of including "new" questions (i.e. those that have never been presented in an exam) into a question set, see page 3, third paragraph or the paragraph bridging pages 2 and 3, see also the statement annexed to the letter dated 21 April 2020, page 9, fifth paragraph and page 11, last paragraph. These arguments are not relevant for claim 8, because the claimed method comprises evaluating selected questions having data in the database, i.e. questions that have already been presented in previous exams.

4.6 Therefore, for the Board, the objective technical problem is the one given in section 4.5 above.

4.7 The Board points out that the application itself does not provide any specific way of how the objective technical problem is to be solved, but merely states on page 7, lines 26 - 27 that "all of these may be programmed into a computer or a computer network using general programming tools". The Board is of the opinion that a skilled person (i.e. a computer specialist) being provided with the above requirement specifications, i.e. steps a) to c), would implement them in a straightforward manner as part of his daily routine, that is to say without making an inventive step within the meaning of Article 56 EPC 1973.

When doing so, the skilled person would store the questions as well as the related data set associated thereto on a data storage device and perform steps a) to c) by computer-based means. In other words, it would arrive at a system comprising data storage means and computer-based means for performing steps a) to c).

Therefore, the subject-matter of claim 8 does not include an inventive step (Article 56 EPC 1973).

5. The sole request does not meet the requirements of Article 56 EPC 1973. Hence, the appeal must fail.

Although the Board refrains from deciding on the system according to claim 1, it is noted that the Board's communication stated reasons why the subject matter of claim 1 appeared to lack an inventive step as well.

Order

For these reasons it is decided that:

The appeal is dismissed.

Footer - Service & support
  • Service & support
    • FAQ
    • Contact us
    • Subscription centre
    • Official holidays
    • Publications
    • Procedural communications
    • Ordering
    • Glossary
Footer - More links
  • Jobs & careers
  • Press centre
  • Single Access Portal
  • Procurement
  • Boards of Appeal
SoMe facebook 0
European Patent Office
EPO Jobs
SoMe instagram
EuropeanPatentOffice
SoMe linkedIn
European Patent Office
EPO Jobs
EPO Procurement
SoMe twitter
EPOorg
EPOjobs
SoMe youtube
TheEPO
Footer
  • Legal notice
  • Terms of use
  • Data protection and privacy
  • Accessibility