Skip to content
GitLab
Menu
Projects
Groups
Snippets
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
Xiph.Org
aom-rav1e
Commits
f274ac7d
Commit
f274ac7d
authored
Aug 19, 2014
by
Jim Bankoski
Browse files
vp9_rdopt.c : signed unsigned mismatch in choose_tx_size
Change-Id: Id68736ffa71843b02ee3634edc525219d6e54d4f
parent
b29d5173
Changes
1
Hide whitespace changes
Inline
Side-by-side
vp9/encoder/vp9_rdopt.c
View file @
f274ac7d
...
...
@@ -507,7 +507,7 @@ static void choose_tx_size_from_rd(VP9_COMP *cpi, MACROBLOCK *x,
cpi
->
sf
.
use_fast_coef_costing
);
r
[
n
][
1
]
=
r
[
n
][
0
];
if
(
r
[
n
][
0
]
<
INT_MAX
)
{
for
(
m
=
0
;
m
<=
n
-
(
n
==
max_tx_size
);
m
++
)
{
for
(
m
=
0
;
m
<=
n
-
(
n
==
(
int
)
max_tx_size
);
m
++
)
{
if
(
m
==
n
)
r
[
n
][
1
]
+=
vp9_cost_zero
(
tx_probs
[
m
]);
else
...
...
@@ -526,7 +526,7 @@ static void choose_tx_size_from_rd(VP9_COMP *cpi, MACROBLOCK *x,
// Early termination in transform size search.
if
(
cpi
->
sf
.
tx_size_search_breakout
&&
(
rd
[
n
][
1
]
==
INT64_MAX
||
(
n
<
max_tx_size
&&
rd
[
n
][
1
]
>
rd
[
n
+
1
][
1
])
||
(
n
<
(
int
)
max_tx_size
&&
rd
[
n
][
1
]
>
rd
[
n
+
1
][
1
])
||
s
[
n
]
==
1
))
break
;
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment