1. 11 Nov, 2012 1 commit
  2. 07 Nov, 2012 1 commit
    • Ralph Giles's avatar
      Use /bin/echo so -n works on osx. · 0ad11587
      Ralph Giles authored
      The 'echo' built into /bin/sh on MacOS X doesn't support -n, which
      confuses the AC_INIT macro. Use the separate binary which does.
  3. 02 Nov, 2012 2 commits
    • Ralph Giles's avatar
      Fix a ci script typo. · 2effe9d3
      Ralph Giles authored
    • Ralph Giles's avatar
      Attempt to fix the autotools linking issue on jenkins. · 2b4bc458
      Ralph Giles authored
      The jenkins autotools build has never worked because we try to
      build against uninstalled versions of the opus and ogg libraries,
      whose pkg-config files export a static library. This works fine
      for executables, but libtool seemingly can't link a dynamic library
      against a static library.
      We could change the -uninstalled.pc files to reference the libtool
      versions of the libraries, but that breaks the unix makefile builds,
      which of course don't use libtool.
      As a work around, write out our own versions of the pc files and
      use those to reference the file we need.
      Also sets -x on both continuous integration scripts so it's more
      clear what steps are being applied.
  4. 01 Nov, 2012 1 commit
  5. 28 Oct, 2012 1 commit
  6. 27 Oct, 2012 3 commits
    • Timothy B. Terriberry's avatar
      A few small updates to the hostname verification. · 3bc74807
      Timothy B. Terriberry authored
      Fixes the case where a raw IPv6 address would be rejected as not
       looking like a FQDN.
      Also simplifies the wildcard comparison a little.
    • Timothy B. Terriberry's avatar
      Remove OP_SSL_SKIP_CERTIFICATE_CHECK from opusfile_example. · 3f54b9dd
      Timothy B. Terriberry authored
      a7c5b93c flipped the argument to it from true to false, since it
       made certificate checking actually work.
      This commit removes the option entirely to avoid encouraging people
       to use it now that that checking does work.
      seeking_example still disables checking (since it's not really
    • Timothy B. Terriberry's avatar
      Make SSL/TLS certificate checking actually work. · a7c5b93c
      Timothy B. Terriberry authored
      We weren't loading the default certificate store, so there were no
       trusted certificates to validate hosts with, and all checks would
       fail (unless explicitly disabled with
      This adds that call, and also adds hostname verification (which
       OpenSSL does not do for us, because they are morons).
      I've done my best to get the latter right by reading the RFCs, but
       this stuff is complex, it's easy to make mistakes, and I only have
       a limited ability to test it, so caveat emptor.
  7. 26 Oct, 2012 1 commit
    • Ralph Giles's avatar
      Document the release process. · 4f538abc
      Ralph Giles authored
      This is, as far as I can remember, the process I went through
      to produce the 0.1 source and win32 binary packages.
      I also added a few things I wish I'd done, like stripping
      the binaries and including release notes and dependency versions
      in the README to help us remember next time.
  8. 24 Oct, 2012 5 commits
  9. 23 Oct, 2012 9 commits
    • Timothy B. Terriberry's avatar
    • Ralph Giles's avatar
      Don't build the API docs if doxygen isn't available. · bc1985a1
      Ralph Giles authored
      Updates the configure check to match the one in the Opus
    • Ralph Giles's avatar
      Set the autoconf version from git. · cfd4e2c3
      Ralph Giles authored
      AC_INIT requires that the version string passed in be 'static'
      so we can't use the output of a shell invocation. However, it
      can be computed by an m4 shell invocation. This is what autoconf
      itself does to embed its git version number in PACKAGE_VERSION.
      Doing this necessitates the 'echo -n' in git-version.sh. Make
      is smart enough to strip the trailing newline, but AC_INIT is
      not. We must also add -f to autoreconf. Otherwise, autogen.sh
      will only update configure when configure.ac changes, even if
      the output of git-version.sh has changed.
      This is still not ideal, since it runs at autogen.sh time, not
      at 'make' time, which is what we want. This seems to be a limitation
      of an upcoming automake release, which removes the old style
      with PACKAGE and VERSION set by shell variables.
    • Timothy B. Terriberry's avatar
      Don't discard timestamps from invalid packets. · 853393be
      Timothy B. Terriberry authored
      Instead put them on the most recent valid packet on the page.
      Also bullet-proof the offset checking to the "use the current
       position when seeking" code added in 6d61f3f1.
      The previous code relied on the file not changing out from under
       us, which we shouldn't do.
    • Timothy B. Terriberry's avatar
      Fix an assertion failure. · 9bb7bc21
      Timothy B. Terriberry authored
      This is no longer guaranteed after the change in e7661191, so test
       for it explicitly.
      Thanks to Greg Maxwell for the test case.
    • Timothy B. Terriberry's avatar
      One small addendum to 7c52622f. · c372a2eb
      Timothy B. Terriberry authored
      This case can basically only get hit if there's another stream
       multiplexed in with ours, but this avoids re-scanning the same
       data multiple times when it happens.
    • Timothy B. Terriberry's avatar
      Bisect from the current file position when seeking. · 6d61f3f1
      Timothy B. Terriberry authored
      In most cases, this is a minor speed-up at best, but in some it can
       be a big win.
      Also, when forcing a true bisection instead of a secant-step,
       don't add the negative bias to the result.
      This can significantly improve the worst-case.
    • Timothy B. Terriberry's avatar
      Some http improvements. · 7b2cc5f1
      Timothy B. Terriberry authored
      - Attempt to re-use connections when we've already received enough
         data to do so immediately.
      - Make sure when seeking near the end, if the current chunk size is
         such that the _next_ chunk will be half the normal size or less,
         we just ask for the rest of the resource.
      With these two changes, a normal open of a single-chain Opus-only
       file requires exactly two HTTP requests.
      - Also use the response buffer as a dummy buffer when skipping
        This will avoid helgrind errors for multiple writes from
         different threads without locking (should someone be reading
         multiple streams from different threads).
        It's also better for SMP cache contention.
    • Timothy B. Terriberry's avatar
      Be more scrupulous about reading extra data. · 7c52622f
      Timothy B. Terriberry authored
      This can be quite expensive with the http backend, especially if it
       causes us to pass a chunk threshold and issue a new request.
      It also lets us error out more quickly if the underlying stream
       data changes.
  10. 22 Oct, 2012 2 commits
    • Timothy B. Terriberry's avatar
      Bias the offsets in op_predict_link_start(). · 498fc0bd
      Timothy B. Terriberry authored
      We apply a positive bias when the previous bisection point was
       inside the current link, causing us to scan forward a bit instead
       of seeking to a new location.
      This knocks up to 18% off the number of seeks required to open very
       large files with lots of links.
    • Timothy B. Terriberry's avatar
      Fix a few minor nits. · 21f72850
      Timothy B. Terriberry authored
      - The DIGIT character sets shouldn't need to list "0" twice.
      - Avoid a lookup for the port number in getaddrinfo().
      - Resolve the OPUS_SET_GAIN TODO (by refusing to implement a fallback).
      - A few more minor things.
  11. 20 Oct, 2012 5 commits
    • Timothy B. Terriberry's avatar
      Re-do abstract stream reader API. · e2d7b266
      Timothy B. Terriberry authored
      This changes op_read_func to
      a) Take a single byte count to read instead of an "item" count
          (which the http backend couldn't properly support anyway).
      b) Use integers for buffer sizes to avoid having to worry about
          sign differences and whether size_t is larger or smaller than
          opus_int64, etc.
      c) Return an explicit error code (instead of using errno like
         We had already eliminated the use of errno, but we did it by
          treating read errors and EOF identically in all cases.
         This was preventing us from reporting SSL truncation attacks
          from the https backend.
         The https backend now properly reports such errors.
      This commit also fixes a bug introduced in 9b57b0c2, where we
       accidentally started passing absolute offsets to the _boundary
       parameter of op_get_next_page() instead of relative offsets.
      We now use absolute offsets in all places, as it is the simpler
      This matters now, because the error reported when encountering EOF
       before hitting the _boundary is no longer suppressed (but instead
       reported as OP_EBADLINK).
      Finally, it removes the op_page_seek() function.
      Except for the time needed to decode forward after seeking, this
       function was identical in performance to op_pcm_seek(), and Opus
       requires decoding 80 ms of data after seek anyway, so the relative
       benefit is much smaller than with Vorbis.
      A survey of open-source code using libvorbisfile showed that the
       only usages of ov_page_seek() in the wild were calling it to seek
       to the start of the stream, for which op_pcm_seek() already has a
       special case that makes it just as fast.
      The documentation was also updated to describe all of these chanes.
      This is an incompatible API change.
    • Timothy B. Terriberry's avatar
      Make the URL API more extensible. · 800be8c0
      Timothy B. Terriberry authored
      Right now we have no way to add any more parameters beyond a set of
       basic binary flags.
      This unifies op_url_stream_create() and
       op_url_stream_create_with_proxy() into a single function that
       takes a variable-length list of arguments, which can be extended
       in the future to include more options of any type.
      This is an incompatible API change.
    • Timothy B. Terriberry's avatar
      Fix op_http_parse_connection(). · 756c4c0b
      Timothy B. Terriberry authored
      We were computing the return value correctly, but then not
       returning it.
    • Timothy B. Terriberry's avatar
      Some http robustness improvements. · f83266d9
      Timothy B. Terriberry authored
      - Increase the maximum response header buffer size up to ~32 kB.
        This also moves it into a heap-allocated buffer instead of the
         stack, as 32 kB is really too much for the stack.
      - Treat LF as CR LF when parsing headers.
        This is necessary when parsing the load-balancer response in
         front of <http://lazaradio.hu:8100/bermuda.opus>.
        The response returned by that server is invalid in lots of ways,
         but with these two changes we can read it.
      - In addition, we now peek ahead at a large chunk of data when
         reading the response instead of reading 2 to 4 bytes at a time.
        This allows a typical response to be read with two syscalls
         (one peek, one read) instead of several hundred.
      - Stop trying to read more data when the connection is closed.
    • Timothy B. Terriberry's avatar
      Documentation revisions and a leak fix. · 2ffd8cb7
      Timothy B. Terriberry authored
      Thanks to Jean-Marc Valin for providing documentation feedback.
      This also changes op_tags() to allow the tags to be queried on a
       partially-open file (because they've already been read and are
       available), and fixes a leak when a partially open file is freed
       instead of being fully opened.
  12. 14 Oct, 2012 1 commit
    • Timothy B. Terriberry's avatar
      Fix some socket connection bugs. · bb8cb7a3
      Timothy B. Terriberry authored
      The big one was that if the connect() call failed, it would loop
       forever (thanks to some code re-factoring, the loop was no longer
       advancing to the next address as originally designed).
  13. 13 Oct, 2012 1 commit
    • Timothy B. Terriberry's avatar
      Remove an assert. · e88aa498
      Timothy B. Terriberry authored
      On the first request made by a connection, the value it was testing
       might be uninitialized, so we can't guarantee it'll pass.
  14. 12 Oct, 2012 1 commit
    • Timothy B. Terriberry's avatar
      Major updates to the http backend. · 3d78feff
      Timothy B. Terriberry authored
      * Now supports HTTP/1.1 persistent connections with pipelining.
        This speeds up chain enumeration on large files by almost a
         factor of 2 over http, and by roughly a factor of 4 over https.
        The difference between http and https is now much smaller.
      * Add timeouts to all the socket I/O.
      * Estimate the number of available bytes to read and use it when
         making connection re-use decisions.
      * Add support for https with proxies using HTTP/1.1 CONNECT
      * Fix TLS session re-use (it requires clean shutdown).
      * Various other code re-organization and minor improvements.
  15. 09 Oct, 2012 2 commits
  16. 07 Oct, 2012 1 commit
  17. 02 Oct, 2012 1 commit
  18. 01 Oct, 2012 2 commits
    • Ralph Giles's avatar
      Fix git-version.sh invocation. · 30074799
      Ralph Giles authored
      Making it exectutable doesn't put it in the path, so we have to
      call it ./git-version.sh from inside the doc directory.
      Jenkins didn't catch this because the $(shell ...) return code
      doesn't seem to be propagated to make itself. It prints a warning
      but doesn't abort. I don't know if there's a way to fix that.
    • Ralph Giles's avatar
      Make git-version.sh executable. · eb35299b
      Ralph Giles authored
      Lets us call it directly without /bin/sh which saves space.