Skip to content
GitLab
Projects
Groups
Snippets
/
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
Xiph.Org
aom-rav1e
Commits
ee961599
Commit
ee961599
authored
Aug 29, 2013
by
Yaowu Xu
Committed by
Gerrit Code Review
Aug 29, 2013
Browse files
Merge "Fixed potential overflows"
parents
e80bf802
aaa7b444
Changes
1
Hide whitespace changes
Inline
Side-by-side
vp9/encoder/vp9_rdopt.c
View file @
ee961599
...
...
@@ -1247,7 +1247,7 @@ static int64_t rd_pick_intra_sby_mode(VP9_COMP *cpi, MACROBLOCK *x,
}
if
(
cpi
->
sf
.
tx_size_search_method
==
USE_FULL_RD
&&
this_rd
<
INT64_MAX
)
{
for
(
i
=
0
;
i
<
TX_MODES
;
i
++
)
{
for
(
i
=
0
;
i
<
TX_MODES
&&
local_tx_cache
[
i
]
<
INT64_MAX
;
i
++
)
{
const
int64_t
adj_rd
=
this_rd
+
local_tx_cache
[
i
]
-
local_tx_cache
[
cpi
->
common
.
tx_mode
];
if
(
adj_rd
<
tx_cache
[
i
])
{
...
...
@@ -3816,7 +3816,7 @@ int64_t vp9_rd_pick_inter_mode_sb(VP9_COMP *cpi, MACROBLOCK *x,
tx_cache
[
ALLOW_32X32
]
=
tx_cache
[
ALLOW_16X16
];
}
if
(
!
mode_excluded
&&
this_rd
!=
INT64_MAX
)
{
for
(
i
=
0
;
i
<
TX_MODES
;
i
++
)
{
for
(
i
=
0
;
i
<
TX_MODES
&&
tx_cache
[
i
]
<
INT64_MAX
;
i
++
)
{
int64_t
adj_rd
=
INT64_MAX
;
if
(
this_mode
!=
I4X4_PRED
)
{
adj_rd
=
this_rd
+
tx_cache
[
i
]
-
tx_cache
[
cm
->
tx_mode
];
...
...
Write
Preview
Supports
Markdown
0%
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment