T 1591/13 07-03-2019

I. The appeal is against the decision of the examining division dated 25 February 2013 refusing European patent application No. 05793444.0, which was published as international application WO 2006/043500 A1.

II. The application was refused on the grounds that the invention was not disclosed in a manner sufficiently clear and complete for it to be carried out by a person skilled in the art (Article 83 EPC), and that the subject-matter of claim 1 of the main request and the first to third auxiliary requests extended beyond the content of the application as filed (Article 123(2) EPC).

III. The applicant filed notice of appeal. With the statement of grounds of appeal, the appellant filed amended claims 1 to 8 and requested that the decision under appeal be set aside and that a patent be granted on the basis of the claims filed with the statement of grounds of appeal (main request) or, alternatively, on the basis of the claims of the first, second or third auxiliary request which had formed the basis for the decision under appeal. The appellant provided arguments as to why the application met the requirements of Article 83 EPC and the subject-matter of the claims of all requests met the requirements of Article 123(2) EPC.

IV. The board issued a summons to oral proceedings. In a communication under Article 15(1) RPBA (Rules of Procedure of the Boards of Appeal, OJ EPO 2007, 536), annexed to the summons, the board gave its provisional opinion that the requirements of Articles 83 and 84 EPC 1973 were not met, and that the subject-matter of claim 1 of each of the requests extended beyond the content of the application as filed (Article 123(2) EPC).

V. With its reply dated 6 February 2019, the appellant filed amended claims of a main request and an auxiliary request and amended description pages 17, 18 and 19. It indicated a basis for the amendments and submitted arguments as to why the amended claims met the requirements of Articles 83 and 84 EPC 1973. The appellant also submitted the document "Recommendation ITU-R BT.500-13 (01/2012)", which disclosed methods for the subjective assessment of the quality of television pictures.

VI. On 7 March 2019, the board held oral proceedings.

The appellant was represented. It filed amended claims of a new main request, which replaced the claims of the previous main request.

The appellant's final requests were that the decision under appeal be set aside and that a European patent be granted on the basis of the claims according to the main request filed at the oral proceedings of 7 March 2019 or, in the alternative, on the basis of the claims according to the first auxiliary request filed by letter dated 6 February 2019, or according to one of the second to fourth auxiliary requests corresponding to the first to third auxiliary requests underlying the decision under appeal.

At the end of the oral proceedings, the chairman announced the decision.

VII. Claim 1 of the main request reads as follows:

"A video quality objective assessment device which estimates a subjective quality of a video, characterized by comprising:

a temporal/spatial feature amount derivation unit (12) which derives a temporal/spatial feature amount (PC) as a feature amount of deterioration which has occurred in a deteriorated video signal, using the deteriorated video signal (PI) and a reference video signal (RI) as a signal before deterioration of the deteriorated video signal; and

a subjective quality estimation unit (14) which estimates a subjective quality, Y, concerning the deteriorated video signal (PI) by weighting the temporal/spatial feature amount, PC, using first coefficients, a, gamma, preset by user's subjective assessment characteristics of a video, wherein the first coefficients a, gamma are obtained by determining a combination of optimal values so as to properly match the subjective assessment by the user with the objective assemement [sic] value Y by checking the subjective assessment characteristic of the user with respect to the video (PI) in which local video deterioration has occurred while chaning [sic] the deterioration amount;

said temporal/spatial feature amount derivation unit (12) comprising

first derivation means (121) for deriving the spatial feature amount, DS, of deterioration which has occurred in an assessment target frame of the deteriorated video signal (PI),

second derivation means (122) for deriving a temporal feature amount (C) of the deterioration which has occurred in the assessment target frame of the deteriorated video signal (PI), and

third derivation means (123) for deriving the f temporal/spatial feature amount, PC, using the spatial feature amount, DS, and the temporal feature amount, C),

wherein said first derivation means (121) calculates a deterioration amount (Si) of each block obtained by dividing the assessment target frame from the deteriorated video signal and the reference video signal, calculates, as a statistics, Xave_all, Xave_bad, of a spatial deterioration amount (S) distribution in the assessment target frame, a frame average deterioration amount, Xave_all, as a value obtained by averaging deterioration amounts over the entirety of the assessment target frame and a local deteriorated region average deterioration amount, Xave_bad, as a value obtained by averaging deterioration amounts belonging to a region of the assessment target frame in which deteriorations falling in a predetermined deterioration intensity range have occurred, and determines said spatial feature amount, DS, from second coefficients, A, B, preset by the user's subjective, assessment characteristic of the video and said statistics, Xave_all; Xave_bad, of the spatial deterioration amount distribution, where A is a coefficient obtained in advance by a subjective assessment characteristic when no local video deterioration has occured in space, and B is is [sic] a coefficient obtained in advance by a subjective assessment characteristic when local video deterioration has occurred in space, and;

said third derivation means (123) performs a function of using said spatial feature amount, DS, as the deterioration amount, C, to derive said temporal/spatial feature amount, PC, every measurement time (ut) based on the deterioration amount, C, in the presence of a localized video deterioration occurring on a time axis, an average deterioration amount, Dcons, in a steady state in the absence of the localized video deterioration occurring on the time axis, and the user's subjective assessment characteristic of the video,; and

said third derivation means (123) further determines, in said function, a localized video deterioration discrimination threshold (Fig. 12) on the basis of the average deterioration amount, Dcons, in a steady state calculated in an immediately preceding measurement time (ut) to thereby determine that the localized deterioration has occurred on the time axis when, in a current measurement time (ut), a difference between a deterioration amount, C, and the average deterioration amount, Dcons, in the steady state calculated in the immediately preceding measurement time is not smaller than the local deterioration discrimination threshold,

wherein a deterioration amount, C, at which the difference is not smaller than the local deterioration discrimination threshold is set as the deterioration amount, d, in the presence of the localized video deterioration."

VIII. Claim 1 of the first auxiliary request reads as follows:

"A video quality objective assessment device which estimates a subjective quality of a video, characterized by comprising:

a temporal/spatial feature amount derivation unit (12) which derives first and second temporal/spatial feature amounts (PC; X1, X2, ... , Xn) as feature amounts of deterioration which has occurred in a deteriorated video signal, using the deteriorated video signal (PI) and a reference video signal (RI) as a signal before deterioration of the deteriorated video signal; and

a subjective quality estimation unit (14) which estimates a subjective quality (Y) concerning the deteriorated video signal (RI) by weighting the first and second temporal/spatial feature amounts (PC; X1, X2, ... , Xn) using first coefficients (a, beta, gamma) preset by user's subjective assessment characteristics of a video,

said temporal/spatial feature amount derivation unit (12) comprising

first derivation means (121) for deriving a spatial feature amount (DS) of deterioration which has occurred in an assessment target frame of the deteriorated video signal (PI),

second derivation means (122) for deriving a temporal feature amount (C; frame rate; frame skip count; TI value) of the deterioration which has occurred in the assessment target frame of the deteriorated video signal, and

third derivation means (123) for deriving the first and second temporal/spatial feature amounts (PC; X1, X2, ... , Xn) using the spatial feature amount (DS) and the temporal feature amount (C; frame rate; frame skip count; TI value),

wherein said first derivation means (121) calculates a deterioration amount of each block obtained by dividing the assessment target frame from the deteriorated video signal and the reference video signal, calculates, as a statistics (Xave_all, Xave_bad) of a spatial deterioration amount (S) distribution in the assessment target frame, a frame average deterioration amount (Xave_all) as a value obtained by averaging deterioration amounts over the entirety of the assessment target frame and a local deteriorated region average deterioration amount (Xave_bad) as a value obtained by averaging deterioration amounts belonging to a region of the assessment target frame in which deteriorations falling in a predetermined deterioration intensity range have occurred, and determines said spatial feature amount (DS) from second coefficients (A, B) preset by the user's subjective assessment characteristic of the video and said statistics (Xave_all; Xave_bad) of the spatial deterioration amount distribution and;

said third derivation means (123) performs a first function of using said spatial feature amount (DS) as the deterioration amount to derive said first temporal/spatial feature amount every measurement time based on the deterioration amount in the presence of a localized video deterioration occurring on a time axis, an average deterioration amount (Dcons) in a steady state in the absence of the localized video deterioration occurring on the time axis, and the user's subjective assessment characteristic of the video, and a second function of using said temporal feature amount as the deterioration amount to derive said second temporal/spatial feature amount every measurement time based on the deterioration amount in the presence of the localized video deterioration occurring on the time axis, the average deterioration amount (Dcons) in the steady state in the absence of the localized video deterioration occurring on the time axis, and the user's subjective assessment characteristic of the video; and

said third derivation means (123) further determines, in each of said first and second functions, a localized video deterioration discrimination threshold on the basis of an average deterioration amount in a steady state calculated in an immediately preceding measurement time to thereby determine that the localized deterioration has occurred on the time axis when, in a current measurement time, a difference (d) between a deterioration amount and the average deterioration amount in the steady state calculated in the immediately preceding measurement time is not smaller than the local deterioration discrimination threshold, an average deterioration amount in the steady state obtained when the localized video deterioration on the time axis does not occur in the current measurement time, wherein a deterioration amount at which the difference (d) is not smaller than the local deterioration discrimination threshold is set as the deterioration amount in the presence of the localized video deterioration, and the average deterioration amount in the steady state is calculated by using an average value of deterioration amounts in the steady state obtained by removing time when the localized video deterioration is occurring from the current measurement time."

IX. Claim 1 of the second auxiliary request reads as follows:

"A video quality objective assessment device which estimates a subjective quality of a video, characterized by comprising:

a temporal and spatial feature amount derivation unit (12) which derives first and second temporal and spatial feature amounts (PC; X1, X2, ... , Xn) as feature amounts of deterioration which has occurred in a deteriorated video signal, using the deteriorated video signal (PI) and a reference video signal (RI) as a signal before deterioration of the deteriorated video signal; and

a subjective quality estimation unit (14) which estimates a subjective quality (Y) concerning the deteriorated video signal (RI) by weighting the first and second temporal and spatial feature amounts (PC; X1, X2, ... , Xn) using coefficients (a, beta, gamma) preset by subjective assessment characteristics of a video,

said temporal and spatial feature amount derivation unit (12) comprising

first derivation means (121) for deriving a spatial feature amount (DS) of deterioration which has occurred in an assessment target frame of the deteriorated video signal (PI),

second derivation means (122) for deriving a temporal feature amount (C; frame rate; frame skip count; TI value) of the deterioration which has occurred in the assessment target frame of the deteriorated video signal, and

third derivation means (123) for deriving the first and second temporal and spatial feature amounts (PC; X1, X2, ... , Xn) using the spatial feature amount (DS) and the temporal feature amount (C; frame rate; frame skip count; TI value),

wherein said first derivation means (121) calculates a deterioration amount of each block obtained by dividing the assessment target frame from the deteriorated video signal and the reference video signal, calculates, as a statistics (Xave_all, Xave_bad) of a spatial deterioration amount (S) distribution in the assessment target frame, a frame average deterioration amount (Xave_all) as a value obtained by averaging deterioration amounts over the entirety of the assessment target frame and a local deteriorated region average deterioration amount (Xave_bad) as a value obtained by averaging deterioration amounts belonging to a region of the assessment target frame in which deteriorations falling in a predetermined deterioration intensity range have occurred, and determines said spatial feature amount (DS) from the coefficients (A, B) preset by the user's subjective assessment characteristic of the video and said statistics (Xave_all; Xave_bad) of the spatial deterioration amount distribution and;

said third derivation means (123) performs a first function of using said spatial feature amount (DS) as the deterioration amount to derive said first temporal and spatial feature amount every measurement time based on the deterioration amount in the presence of a localized video deterioration occurring on a time axis, an average deterioration amount (Dcons) in a steady state in the absence of the localized video deterioration occurring on the time axis, and the user's subjective assessment characteristic of the video, and a second function of using said temporal feature amount as the deterioration amount to derive said second temporal and spatial feature amount every measurement time based on a deterioration amount in the presence of a localized video deterioration occurring on the time axis, an average deterioration amount in the steady state in the absence of the localized video deterioration on the time axis, and the user's subjective assessment characteristic of the video; and

said third derivation means (123) further determines, in each of said first and second functions, a localized deterioration discrimination threshold on the basis of an average deterioration amount in the steady state calculated in an immediately preceding measurement time to thereby determine that the localized deterioration has occurred on the time axis when a difference (d) between a deterioration amount in a current measurement time and the average deterioration amount in the steady state calculated in the immediately preceding measurement time is not smaller than the local deterioration discrimination threshold, an average deterioration amount in the steady state obtained when the localized video deterioration on the time axis does not occur in the current measurement time."

X. Claim 1 of the third auxiliary request differs from claim 1 of the second auxiliary request in that the last feature reads as follows:

"said third derivation means (123) further determines, in each of said first and second functions, a localized deterioration discrimination threshold on the basis of an average deterioration amount to thereby determine that the localized deterioration has occurred on the time axis when a difference (d) between a deterioration amount in a current measurement time and the average deterioration amount in the steady state calculated in the immediately preceding measurement time is not smaller than the local deterioration discrimination threshold, a degradation amount obtained when the difference is not less than the localized deterioration discrimination threshold is defined as deterioration amount obtained upon occurring the localized video deterioration on the time axis in the current measurement time, and an average deterioration amount in the steady state obtained when the localized video deterioration on the time axis does not occur in the current measurement time".

XI. Claim 1 of the fourth auxiliary request differs from claim 1 of the second auxiliary request in that the last feature reads as follows.

"said third derivation means (123) further determines, in each of said first and second functions, a localized deterioration discrimination threshold on the basis of an average deterioration amount in the steady state calculated in an immediately preceding measurement time to thereby determine that the localized deterioration has occurred on the time axis when a difference (d) between a deterioration amount in a current measurement time and the average deterioration amount in the steady state calculated in the immediately preceding measurement time is not smaller than the local deterioration discrimination threshold, a degradation amount obtained when the difference is not less than the localized deterioration discrimination threshold is defined as a deterioration amount obtained upon occurring the localized video deterioration on the time axis in the current measurement time, and an average deterioration amount in the steady state obtained when the localized video deterioration on the time axis does not occur in the current measurement time".

XII. The examining division's objections, where relevant to the present decision, may be summarised as follows.

The definitions of the steady-state average deterioration amount and the local video deterioration set out in the description on page 18, line 19, to page 19, line 10, did not allow a person skilled in the art to determine the steady-state average deterioration amount and the local video deterioration (see decision under appeal, point 11.2).

XIII. The appellant's arguments, where relevant to the present decision, may be summarised as follows.

(a) In response to the discussion during the oral proceedings, claim 1 of the main request was amended to exclude a video quality assessment based on the frame rate.

(b) The term "weighting" in claim 1 of the main request was to be understood as scaling the temporal/spatial feature amount with coefficients chosen to optimise the approximation of the subjective assessment.

(c) The steady-state average deterioration amount was more or less constant and the skilled person could generally speak of the steady-state average deterioration amount Dcons without explicitly referring to a specific measurement interval (see statement of grounds of appeal, pages 7 and 8). The average deterioration amount Dcons converged to an appropriate steady-state value as time passed (see statement of grounds of appeal, the paragraph bridging pages 9 and 10).

(d) Deterioration amounts C were calculated for each unit measurement interval (see description, page 17, lines 8 to 15), with "ut >= one frame interval" (see amended description, page 17, line 4 and letter dated 6 February 2019, page 6). The measurement interval ut was typically significantly larger than the frame interval (see letter dated 6 February 2019, page 7, first paragraph).

(e) The frame rate could be determined as the inverse of the time between two consecutive frames. Dcons was then defined as the average of these inverse values over the measurement interval.

(f) It was common in computer implemented inventions to derive and store, in advance, parameters used in subsequent processing. The derivation of these parameters need not be claimed. Although the user's subjective assessment characteristics were not defined in the claims they could be derived in advance from experiments using a subjective estimation method as described in, for example, ITU-R BT.500-13, page 12, section 4.5 (see letter dated 6 February 2019, page 3, first full paragraph).