Old Change Logs

minor cleanup

Added the load_image_dataset() routine.

A minor change to avoid warnings from visual studio

Added some comments

Moved the image dataset metadata IO functions into the dlib folder.

Made determine_object_boxes() a little more robust.  Previously, it
would sometimes select an invalid set of object boxes.

Added a heatmap colormap.

Just renamed the file to colormaps.h

Made the code more robust so it works with pyramid_disable.

Added the pyramid_up() routine.

Added a resize_image() routine.

Fixed compiler error in visual studio 2010

Clarified spec

Added more comments

Filled out spec for rls_filter and added asserts

Filled out the spec for the kalman_filter object.

Added unit tests for rls_filter and kalman_filter.

cleaned up the kalman filter code a little.

Fixed typo in error message

Added is_array template.

clarified spec

All I did in this commit was remove any of the ::kernel_1a, ::expand_1a,
qualifiers from any uses of dlib::array.

Just renamed this file

Renamed the array implementation file to something more appropriate.

Removed more cruft

Removed old array multi-implementation files now that it's all merged into
the one implementation.

Turned the array into a single implementation object.  Now arrays can be
created using the normal array<type> obj; syntax.  Additionally, all extensions
were put into the array object directly and the implementation is the
flat single array implementation.

Removed the unreasonable requirement that images given to the pyramid
down routines be at least 10 pixels on each side.

clarified spec

Added pyramid_disable.

Added some more convenient overloads of the zeros_matrix(), ones_matrix(),
and identity_matrix() functions.

Added serialization support for the rls, rls_filter, and kalman_filter objects.

Added the rls_filter object.

Improved numeric stability of rls.  This change also makes it keep the
regularization at a constant level even when exponential forgetting is
used.

clarified spec

Added unit tests for the circular_buffer and fixed a few things.

Added a circular_buffer object.  It is like sliding_buffer except it can
have sizes which aren't powers of 2.

adding initial version of kalman filter code

Added the 128bit hash version of Murmur hash.

Added missing asserts.

Clarified spec

filled out spec

Added code for doing image interpolation, rotations, and general transformations.

Updated the min and max functions so that they work with complex
numbers in the same manner as MATLAB.

Made sum() and mean() work with complex numbers.

Changed the xcorr functions so they take the complex conjugate of the right
hand arguments if they are complex numbers.  This way they do a proper
cross-correlation and also mirror the behavior of MATLAB.

Made byte_orderer copyable.

Fixed missing std:: compiler error.

Added dcenter(), point_transform_affine, and rotation_matrix()

Added the point_transform object

Added tests for the rls object

Fixed a bug which caused certain matrix expressions to not compile
when the BLAS bindings were enabled.  In particular, expressions which
involved a 1x1 matrix sometimes didn't compile.

Added an implementation of the linear recursive least squares algorithm.

Updated the sequence labeling trainer to allow the user to set different loss
values for different labels.

Added unit tests for the new get_option() routine.

Fixed a bug which prevented get_option() from compiling if given both a
command line parser and config reader.

Added the get_option() routines which slightly simplify getting options
from command line parsers and config readers.

Added an is_config_reader template.

Fixed incorrect assert

Added the option to make the poly features rotationally invariant.
This change breaks backwards compatibility with the previous version.

Added the pad_int_with_zeros() function.

Changed timing routines so you can name each timing block.

Added another add_overlay() overload.

Simplified the add_overlay() interface for image_window.

fixed #include

Added a tool for timing blocks of code

Minor change to avoid a bug in clang 2.9

A few more minor changes to avoid problems with GCC 4.2.1

Minor changes to avoid bugs in GCC 4.1.2 on Debian Etch

I changed the sequence labeling stuff to allow a user defined
sequence type.  So these changes are basically just renaming some
template arguments and minor changes to some typedefs.

Added a unit test for fine_hog_image.

Added fine_hog_image object

Cleaned up the interface for normalization.

Changed poly_image to allow the user to decide if intensity normalization
should be used.

Clarified spec

Clarified spec

Just cleaned up the code a little to make it easier to follow.

Added missing default argument value

Made the object_detector's interface a little more flexible.

Added some member functions to allow the user to set the minimum size
of an image pyramid layer.

Fixed an array indexing bug.

Added some code to help detect and debug improperly coded feature extractors.

Made this code a little more robust.

Improved how matching rectangles are found.  Now get_best_matching_rect()
will use the same matching measure as the rest of the code.

Added a verbose version of setup_grid_detection_templates()

setup_hashed_features() wasn't copying the configuration of the
feature extractor into the scanner.  Fixed this problem.

Clarified spec

Fixed grammar

clarified spec

Added a static const long copy of downsample so you can obtain its value
given only a poly_image type.

Added more unit tests

fixed linker error

minor cleanup

Added the poly_image local feature extractor.

Added the nearest_neighbor_feature_image object.

Fixed formatting

clarified spec

updated a comment

Moved sum_filter() into the file with all the other filtering routines.

Clarified spec

Made the spatial filtering routines return a rectangle which tells you what
part of the image wasn't just zero padding along the border.

Added some overloads of shrink_rect() and grow_rect() which
allow you to adjust the width and height independently.

Renamed a test function so it doesn't show up in the ctags list.

Added the spatially_filter_image_separable_down() routine which is just a version
of spatially_filter_image_separable() that does downsampling at the same time
as it does the filtering.

Made the border_enumerator a little more flexible.  Now the border
doesn't need to be the same size on all sides of a rectangle.

Fixed bugs in this test

Made this code a little more flexible with regard to input matrix type.

Gave the spatially_filter_image routines the ability to add their
results to an output image rather than overwrite the contents
of the output image.

Added an unload() to the hog_image.

Fixed improper normalization in the gaussian() functions.  The
normalization constant was being computed incorrectly.

Reworked the scan_image() routine to make it run faster.  Also added
a new function called sum_filter().

Changed code a bit to make it run faster.

Removed unnecessary load() calls now that they aren't required.

Removed the requirement that an image be loaded before
calling get_best_matching_rect().

Made this object cache image scanner objects internally rather than
reconstruct them for each separation oracle call.

Made this code a little more efficient.

Removed unnecessary requirement on get_block_rect()

Removed cruft

changed code to avoid a compiler warning

Added more serialization tests for dlib::rand.

Changed to avoid compiler error in visual studio 2005

Fixed linker error.

Added the setup_grid_detection_templates() routine.

Added determine_object_boxes()

Made the spec a little clearer.

Made the randomly_sample_image_features() routine a little more general.
Also improved its spec.

Added some more tests and also fixed the existing ones to work
given the recent changes to the object detection tools.

Added the setup_hashed_features() helper routine for configuring
a scan_image_pyramid when it is used with a hashed_feature_image
and projection_function.

Added some useful typedefs to this object.

Added the randomly_sample_image_features() routine.

Fixed constness bug

Clarified spec

Removed constness from the operator() member functions of the object_detector
since they logically modify the state of the object detector now that
we are exposing the state of the underlying image scanner.

Refactored code into a cleaner form.

Made the object_detector's interface a little more complete and flexible.

Made this trainer automatically determine decent parameters
for the test_box_overlap object when it is used and the user
hasn't specifically assigned an overlap tester.

Fixed grammar

The word "overlap" was used to describe the concept of a rectangle
matching with a truth rectangle as well as overlap in the context of
non-max suppression of results.  Since these are two very separate
ideas I renamed some things to avoid any confusion.

Refactored this object so it uses a hashing function supplied
by a template argument rather than its own method.  By default,
this object will use the projection_hash.

Added asserts and filled out the spec files.

Moved create_random_projection_hash() into its own file.

Added some basic locality sensitive hashing tools.

Refined the scan_image_pyramid interface a little.  In particular, I split the
get_feature_vector() method into two separate functions so the interface
is a little simpler and more flexible.

Renamed a variable to make the code clearer.

Improved an error message.

Made the test_box_overlap a little more flexible.  This change breaks
backwards compatibility with the previous version though.

Added an operator != to the file and directory objects.

Added another member function which enables you to get the detection
strengths from the object_detector.

updated spec

Added some simple normality tests for the new rand::get_random_gaussian() method.

Added a function for generating Gaussian random numbers.

Fixed a typo in the spec.

Improved error messages from object detector.

The object_detector had code in it which limited the number of outputs
to 100 rectangles.  This has been removed.

Made assign_image() and assign_image_scaled() capable of assigning to
matrices.

changed code to avoid a compiler warning

Fixed a bug which triggered when using variable length matrices
as the feature vector type.

Changed code so it compiles in visual studio 2010

Changed the add_probability() method of joint_probability_table so
it does a saturating add rather than a normal add.  This ensures the
probability value stays exactly <= 1.  Previously, floating point
rounding error could cause it to be slightly above 1 and would therefore
cause some asserts to misfire during debugging mode.

fixed some typos in assert messages

Fixed a bug which caused the tests to fail if run more than once.

Changed code to avoid a compiler warning

Made the sequence trainer use the reject_labeling() information from
the feature extractor.  Also added the necessary input validation
to make sure this feature doesn't get misused.

Added the contains_invalid_labeling() routine.

Added unit tests for the assignment learning stuff

Relaxed the requirements on the feature extractor interface and also
added some tests to make sure the code really does work with the
relaxed interface.

Added methods to get the assignment by reference rather than returning
a copy by value.

Clarified specs

Clarified spec

Made the order of constructor arguments in the various overloads
for the assignment_function and sequence_labeler consistent.

Filled out the spec and added the usual boilerplate for a trainer object.

removed cruft

Fixed a minor bug in how the cross validation accuracy was being
computed.

Fixed spelling error in comment.

Added a missing assert.

Added a spec for the structural_svm_assignment_problem and added missing asserts.

Added a spec for the assignment problem validation functions and added
missing asserts.

fleshed out this spec

clarified spec

renamed some things

Made the feature_extractor interface a little more efficient.

Setup serialization support for assignment_function objects.

Added initial version of the assignment problem learning code.

Just added some comments about setting up proper input validation
when the user uses the sequence label rejection feature.

Added the is_assignment_problem() and is_forced_assignment_problem() routines.

Clarified spec

Added a test for 64 bit integers.

Minor changes to avoid compiler warnings from clang++

Minor changes to avoid compiler warnings in gcc

Added the histogram intersection kernel for sparse and dense vectors.

The last dlib release added a max_iterations parameter to the
svm_c_linear_trainer and svm_c_ekm_trainer objects.  However,
there was a bug which made them only ever do at most 16 iterations,
which is too few to solve many problems.  This has been fixed.

added more tests

Clarified spec

Added unit tests for the new sequence labeling stuff

Simplified the sequence_labeler interface a bit.

Made unit test a little more robust.

Minor change to avoid a compiler error in clang

Changed a little to work around a bug in visual studio 2005

changed to avoid a compiler error

Changed code a little to make the reject_labeling() routine optional.
Now if you don't define it you get a reasonable default behavior
rather than a compiler error.

Filled in the rest of the interface for the structural_sequence_labeling_trainer
and cleaned up a few other related things.

fixed grammar

Refactoring and spec improvement.  Still some work left to do though.

fleshed out the spec

minor cleanup

Refactored code a little and added more comments to spec.

Made this object inherit from noncopyable

setup serialization for the sequence_labeler.

Added a set of tools to allow a user to easily learn to do sequence
labeling using dlib's structural SVM implementation.

Added the is_sequence_labeling_problem() routine.

Added some missing validation of the user supplied number of folds
to the cross_validate_multiclass_trainer() routine.  Not it will
throw an exception if the number of folds is too big rather than
just producing a confusing result.

Clarified the spec regarding the type of sparse vector supported
by these two objects.

Clarified the sparse vector spec and formally introduced the concept
of unsorted sparse vectors.

Fixed a bug in find_max_factor_graph_viterbi() which occurred when a
zero order model had negative factor values.

Clarified spec

Changed find_max_factor_graph_viterbi() so you can use run-time
defined order and num_states parameters.

Fixed a bug in the statement::get_column_as_text() routine.  It didn't
work right if the column contained a NULL.

Minor change to avoid a warning in gcc

Removed unused variables.

Changed makefile slightly so it compiles in Ubuntu 11.10

Added the is_array2d template.

Fixed a bug in is_const_type.  It didn't work right for reference types.

Added unit tests and fixed a few issues.

Clarified spec

Improved spec

Added functions for computing the convolution and cross-correlation between
two matrices.

Added flip()

fixed typo in spec

Fixed invalid assert

Added the segment_image() routine.

Added randomly_color_image()

improved spec

Added an object to help iterate over the border elements of a rectangle.

Added an implementation of the union-find algorithm.

Added missing requirement to the equalize_histogram() and get_histogram() routines.

fixed typo

clarified spec

Optimized the trust region solver a little bit.

Changed LAPACK bindings so that really small matrices don't use LAPACK
for eigenvalue_decomposition or the triangular solver.

Changed chol() so it only calls LAPACK if the matrix is big enough
to benefit from LAPACK.

Added a constructor to array2d that lets you set its size.

clarified spec

Changed the behavior of gaussian_blur() to make it a little more user friendly.

Added a parameter to control the maximum number of iterations for the
two OCA based svm optimizers.

Fixed a bug pointed out by Justin Solomon which could cause the svr_trainer and
svm_c_trainer to produce incorrect results in certain unusual cases.  Also added
unit tests to make sure the bug stays fixed.

Fixed typo in spec

Added a cast to avoid compiler errors in visual studio.

Added missing assert and made minor refinements to spec.

Added some tests for the label_connected_blobs() function.

Added the label_connected_blobs() routine.

updated spec

Changed suppress_non_maximum_edges() to use the L2 norm instead of L1 norm
for measuring the strength of an edge since this produces a slightly better
result.

Removed an unneeded cast.

Added a convenience routine for blurring an image with a Gaussian filter.

Added is_float_type.

Fixed a bug in the matrix class.  Expressions of the form mat *= mat(0) would
evaluate incorrectly because the *= operator took the right hand side by reference
and thus experienced an aliasing problem.  The other op= operators had similar
problems and have also been fixed.

Increased usability of the dlib CMakeLists.txt file slightly.

setup cmake file to link against sqlite3 if it can find it.

Just removed the sqlite namespace and unindended everything.

Added missing asserts and clarified spec.

Added a C++ wrapper for SQLite.

Changed shared_ptr slightly to avoid warnings from gcc.

Changed find_max_factor_graph_nmplp() to use a simple hash table instead
of std::map.  This is significantly faster.  I also added some missing asserts
to validate that the map problems supplied by the user are valid.

Changed the suppress_non_maximum_edges() routine so that it is more robust
to a wider range of pixel types.

Another minor change to avoid a bug in visual studio 2005.

Changed code to avoid a bug in visual studio 2005

Previously, when using spatially_filter_image(), the intermediate filter computations
were carried out using variables of the same basic type as the input image's pixels.
I changed this to use the scalar type used by the actual filter given to this function
since this should result in fewer surprises (since the filter usually determines what
type is appropriate, not the input image).

Minor change to avoid a compiler warning from gcc.

Added some casts and a few other minor changes to get the code compiling
in gcc 4.1.1.

Fixed some corner cases in find_max_factor_graph_viterbi() and also
added unit tests.

Added missing requirement

Minor clarification.

Added the find_max_factor_graph_viterbi() routine for performing MAP
inference in chain-structured factor graphs.

Renamed a function so auto complete in Vim works more conveniently.

Changed code slightly to avoid a bug in visual studio 2005.

Added unit tests for the new object detection tools

Minor changes to avoid compiler warnings

Fixed grammar.

Fixed spelling error.

Just renamed get_scales() to get_hash_bin_sizes() to make things more clear.

Just renamed find_map_nmplp() to find_max_factor_graph_nmplp()

Minor change to avoid a linker error.

Changed scan_image() so that once the max number of detections is reached
it begins randomly subsampling possible detection locations rather than
just stopping the detection procedure.

clarified the spec

Added some comments.

Fleshed out the spec.

Fixed bugs in asserts.

Added the cross_validate_object_detection_trainer() and test_object_detection_function()
routines.

Improved the error messages generated by the structural_svm_object_detection_problem.

Increased the default max detections per template from 2000 to 10000 since
setting this value too low can sometimes result in the failure of the
structural_svm_object_detection_problem.

clarified spec

Added an initial version of the structural_object_detection_trainer.  This is
a tool for learning the parameters for an object like scan_image_pyramid.

Defaulted the overlap tester type to test_box_overlap.

added missing requirement.

Fixed the width_step() member functions.  They weren't defined in quite the
way they should have been.

Minor change to avoid a compiler warning.

Improved the error messages output when a set of truth rectangles can't be
represented by an image scanner.

Changed the test_regression_function() and cross_validate_regression_trainer()
routines so they return both the MSE and R-squared values rather than just the
MSE.

- Renamed spatially_filter_image() for the separable case to spatially_filter_image_separable()
 - Changed the behavior of spatially_filter_image().  Now it won't truncate signed pixel values
   to 0 if they go negative.

Changed the interface for the spatially_filter_image() routines to take the filter
as a matrix rather than C-array.  I also fixed a bug which showed up when using
non-square filters.  The bug would cause the edges of the output image to be incorrect.

Increased the max size matrix which will allocate its memory on the stack
from 128 bytes to 256 bytes.

changed to avoid a compiler warning

Added an overload of spatially_filter_image() that uses a separable filter.

Added functions to the interface that allow a user to control the relative
loss from a false alarm vs. a missed detection.

setup separate measures of loss for false alarms and missed truth boxes.

Added comments clarifying the thread safety requirements of the new
object detection tools.

Removed some testing/debugging code like internal asserts, cout
statements, and other cruft.

Added yet more missing asserts

Added a missing assert

Added a missing assert and fixed some typos.

Added missing assert

simplified this object a little bit.

Fixed a bug in the cpp_tokenizer that only shows up on newer versions of
gcc.  It wasn't tokenizing double quoted strings right.

filled out spec

improved the spec

Added some comments.  Still need to complete the spec.

filled in the spec

Added a functor for testing if two rectangles overlap.

Added the structural_svm_object_detection_problem object.

Added the object_detector object.

Added some functions for creating detection templates.

Added the scan_image_pyramid object.

Added the hashed_feature_image object.

Fixed typos in spec.

Added missing requirement.

Added some optimized serialization overloads for std::vectors of
characters to take advantage of the fact that you can just write
the contents of memory out in this case.

Fixed typo

Fixed grammar in comment.

Added a copy_configuration() routine to the hog_image.

Added a get_num_dimensions() method to the hog_image.

Changed the set_current_dir() implementation so that it compiles in visual studio
even when compiling with unicode strings enabled.

Added cast to avoid compiler warning in visual studio 2010

Added the scan_image() routine.  It is a tool for sliding a set of rectangles
over an image space and finding the locations where the sum of pixels in
the rectangles exceeds a threshold.

clarified spec

Added a missing requires clause

clarified the spec

updated the spec

Added some unit tests for the find_map_nmplp() routine.

clarified spec

Added the find_map_nmplp() function for performing approximate
MAP inference.

Fixed a bug in the png_loader.  If you loaded an image with an
alpha channel into something without an alpha channel there were
uninitialized values being alpha blended into the image.

Added some overloads of serialize/deserialize for array2d objects
which contain simple 8bit POD pixel types.  This makes the serialize
routines much faster in these cases.

- Formally defined how array2d objects must lay their components out in memory
 - Added width_step() to array2d to help define the memory layout.  Also added
   it to cv_image to keep the interfaces compatible.
 - Fixed a typo in the deserialize for array2d objects.  The template wasn't
   declared properly.

Changed the serialization routine for bgr_pixels to store the pixels
in BGR order rather than RGB.

Added a mem_manager_type typedef so the interface better matches array2d.

Fixing incorrect print statement.

Moved the docs for some functions to the top so that htmlify links to them right.

Changed the interface to the ridge regression trainer objects so that
they report the entire set of LOO prediction values rather than a
summary statistic like mean squared error.

Added the following functions for computing statistics on vectors:
mean_sign_agreement(), correlation(), covariance(), r_squared(),
and mean_squared_error()

Fixed typo in spec

Cleaned up the interface to draw_line()

Added missing inline to avoid compiler errors.

Added a function for computing the center of a rectangle.

Added a test that the pyramid down objects do the coordinate mapping correctly.

Fixed a minor bug in the list_box.  It's behavior was a little awkward
when using the multiple selection feature.

Changed the pyramid down objects so that they make better use of the
available image data.  Previously, more pixels on the right and bottom
of the image were cropped than was necessary.

Updated the block spatial filtering functions so they can operate on
rectangular areas instead of just square areas.

Fixed a bug pointed out by Martin Müllenhaupt which caused the windows socket
code to not compile when used with the mingw-cross-env project.

Made the behavior of the image_window a little more convenient.  Now it will
automatically size itself properly when a zoom is in effect and you place a new
image into it.

The image_display didn't display overlay rectangles quite right.  If you zoomed
in you could see that some of the pixels which are inside the rectangle were
outside the overlay.  Specifically, the right column and bottom row was outside
the overlay rectangle.  This has been fixed.  Now all pixels which are supposed
to be part of a rectangle are drawn as being inside the overlay rectangle.

Made the integral_image more general by making it templated on the
type of scalar used to store the sums.

Added a global operator+ for rectangle+point to make this kind of operation
compile in more contexts.

fixed minor typo in comment

Made hog_image clearable and serializable.

Made running_stats serializable.

Clarified spec.

added more unit tests for hog coordinate transforms

Removed unneeded code.

Added a more complete set of functions for converting between image space and the downsampled hog
grid.  So now you can convert from image to hog instead of just hog to image.  Also added some
related unit tests.

Added fill_rect() for images.

Clarified spec

Added some tests for the new versions of pyramid_down.

Updated image pyramid spec to include new pyramid functions.

Added a version of pyramid_down which scales at a ratio of 5:4

Added a 4:3 pyramid down tool.

Moved the /256 from the spatial filtering routine to it's proper place in the pyramid code.

Made code a little easier to read.

Adding initial version of a 3:2 pyramid

Added some functions for running a 3x3 separable filter on part of an image.

Fixed grammar in comment.

Added a file_exists() function.

Fixed spelling error in comment.

Changed code around so that the save_png.h header file doesn't need to #include png.h.
I did this because png.h will cause the compile to fail if the user #includes setjmp.h
along with png.h.

Added an event handler for when the user selects an overlay rectangle.

Added the ability for the user to delete overlay rectangles from the image_display.
Also added interface functions to programmatically observe what is happening to the
overlays.

Fixed a bug in the svm_struct test.  The test would always fail if run
more than once.

Simplified the CMakeLists.txt file for the unit tests.  Also made it
use Release mode by default.

Minor change to suppress a compiler warning.

removed tabs

Added support for user drawn rectangle overlays and selectable overlays to the
image_display widget.

Added the distance_to_rect_edge() routine.

Made a minor change which apparently avoids a bug in gcc 5.4.2 on Ubuntu 11.04.

Simplified the cmake files by putting the stuff to make Release
the default build into a single file.

Fixed a bug in the image_display widget.  If you switched it between
images of a different size while any kind of zoom was in effect
it could cause a segmentation fault.

Made the global mutex construction for the get_current_dir() and set_current_dir()
routines more robust.

Fixed the code so it compiles on windows.

Added a set_current_dir() function.

Made the horizontal scroll speed for the list_box more reasonable.

Added match_endings to the dir_nav utils.

Added the check_sub_option() method to the command line parser check
object.

Minor change to avoid a compile time error in visual studio 2008.

I improved the way calls to the separation oracle get dispatched to the
thread_pool.  Previously, each separation oracle call was dispatched
to a thread individually.  This is inefficient when there are a whole
lot of samples (and thus separation oracle calls which need to be made).
So now entire batches of separation oracle calls are dispatched to
each thread.  This minimizes the thread switching and synchronization
overhead.

Added extra #include for image_io.h so that future linker errors from
this component will be caught by the unit tests.

Added a bunch of overloads for add_task_by_value()

Removed spurious statement.

Moved the serialize and deserialize function definitions outside the body of the
type_safe_union class to avoid a compiler bug in an older version of gcc.

Fixed a bug which caused multiply defined symbol errors during linking
if the PNG saving routine was #included.

Clarified spec and docs

The structural SVM optimizers had checks that the risk never became negative.
This only happens if the user implements the separation oracle wrong.  In this
case I had the code setup to force the risk to zero but this just ends up
obscuring the fact that the user's separation oracle is incorrect.  So I'm
removing this check.  This should make debugging separation oracles a little
easier.

Added some tests for the new add_task_by_value() methods of the thread_pool.

added a test

Added an add_task_by_value() function to the thread_pool.

Clarified spec again

clarified docs

Switched some member_function_pointers from checking mode to non-checking mode.

Fixed comment

Removed cruft

Made the conversion to and from HSI a little more robust.

Removed time based seed to make test more repeatable.

Changed code slightly to avoid compiler error in visual studio 2005

Added another test

updated spec

Made find_clusters_using_kmeans() work with dlib::vector objects.

Added a kmeans test

Changed code so that an error message is always printed if we run out of memory while
cross_validate_trainer_threaded() is executing.

Increased the hysteresis_threshold() recursion depth a bit.

Made threshold_image() handle signed pixels properly.

Changed hysteresis_threshold() so it properly handles signed pixel types.

Added comments explaining the conversion that might happen when images
are saved to disk by the various save_*() functions.

Fixed a bug in assign_pixel_intensity() that happened when
the target pixel was an RGB pixel with an alpha channel.

Added more tests

Made get_pixel_intensity() more efficient.

Minor change to avoid a compiler error in visual studio 2010

Switched the default hash function for std::strings (when used with hash tables)
to dlib::hash().

minor cleanup

Added another test

Improved hashing tests and clarified spec.

Clarified spec

Added comments regarding endianness and hashing.

Added a hash() for matrices.

Fixed a linker error that happens on gcc.

Added a unit test for the new hashing functions.

Added Austin Appleby's excellent MurmurHash3 hashing code and setup some
additional convenience functions.

Changed comment so htmlify will put an anchor on it.

Changed code to use the new DLIB_ASSERT_HAS_STANDARD_LAYOUT to check
if a type can be swapped rather than the explicit union trick.

Moved DLIB_ASSERT_HAS_STANDARD_LAYOUT into assert.h.

Added a macro to assert on a type being a POD or a standard layout type.
This way I can change just this one macro to use the better C++0x
method of doing this check once C++0x becomes available.

Added some unit tests for the save_png() and load_png() functions.

Switched all the uses of array2d to not use the array2d<type>::kernel_1a
syntax but to use the array2d<type> syntax.

Changed the array2d object so you don't have to say array2d<type>::kernel_1a
anymore to declare it.  Now you just say array2d<type>.

Removed debugging cout statement.

Fixed incorrect exception being thrown.

Fixed compile time test

Added the load_image() function which just looks at a file's extension and
then calls the appropriate image loading function.

Added a bunch of overloads for all the various save_*() and load_*() image
I/O options dlib supports.  Also added ones which can work directly with
a string file name.

Fixed code so it throws the right type of exception.

Added a function for saving to the PNG image format.

updated png_loader so it can load 16bit data.

Made the png_loader::get_image() function a little faster.

Updated png_loaded so it can handle paletted images.

setup proper error handling for libpng in the png_loader.  Now if the PNG
file is corrupted in the middle it won't just print a message and abort
the program.

Added missing requires clause to hysteresis_threshold()

fixed typo in spec

Fixed a spelling error.

Fixed spelling error in a comment.

Added a few more tests

removed tabs

Added a matrix_type typedef to structural_svm_problem_threaded
so it matches the interface of the structural_svm_problem.

Minor change to avoid compiler warning in gcc.

Changed the type_safe_union a little bit to avoid the C4503 warnings
you sometimes get from visual studio about
"decorated name length exceeded, name was truncated".

What I did was introduce a new type called _void as the deafult
template parameter for the type_safe_union rather than use the T1
type as the default for the 19 other parameters.  Since _void is
always a short word it helps keep the warning from showing up.

Removed random seed to make the test more repeatable.

Changed code to avoid compiler error in visual studio.

Added a bunch of unit tests for the various forms of structured svm.

Clarified spec

Worked on the spec and cleaned up the code a little.

clarified spec

Added initial version of a distributed structural svm solver.

Added some requirements and asserts.

Added a function to determine how many threads a structural_svm_problem_threaded
object is going to use.

Simplified code a little bit.

Made caching object a little more robust.

Added some more comments.

Cleaned up the code a little by pulling the caching logic out into its
own class.

Minor change to avoid a compiler warning.

Fixed a bug in the DLIB_TEST_MSG macro for the unit testing suite.  This
bug was introduced a few days ago.

Clarified recent change to the spec

Made the bridge code a little more robust.

Made test more robust

Added a clear() to the bridge and improved some comments and tests.

Added tests for the bridge.

Polished the bridge object a bit.

Yet more code cleanup

minor cleanup

Added initial version of the bridge object.  It is a tool for bridging
pipe objects from one computer to another.

Updated the unit test application so that it prints the number of
individual testing statements which were executed.

Upgraded the type_safe_union with a constructor and assignment operator
which can copy an object into the type safe union.

Gave the pipe the ability to disable dequeue operations.

Fixed a bug which caused the structural_svm_problem_threaded object to
crash when caching was used.

Added a version of the structural_svm_problem which can use multiple threads to
call the separation_oracle() function.

Added a missing #include

Increased the default values for the initial basis size and basis size
increment a little.

Added more comments.

Fixed typo in spec

Renamed all the rand::kernel_1a and rand::float_1a declarations
to just say rand.

Changed the rand object so you don't have to say rand::kernel_1a or
rand::float_1a anymore to declare it.  Now you just say rand.

Changed the stopping condition for the structured svm to the one suggested
by the Joachims paper.  I also added another useful reference to the docs.

Improved the feature vector caching in the structural_svm_problem object.

Changed the oca_problem interface to the oca optimizer.  Now the optimization_status()
function reports back the current risk and risk gap in addition to just the overall
objective value and objective gap.  Note that this change breaks backwards compatibility
with the previous interface (but only slightly).

Made assign_image() and assign_image_scaled() a little more general.  Now
they can use source images which are matrices in addition to array2d objects.
This change also enables the image_window to display matrices.

Added missing #includes

Added a unit test for the pyramid_down object.

Upgraded the pyramid_down function object so it can create color
pyramids.  Not just grayscale ones.

Added some functions which define the coordinate transforms
between different layers in an image pyramid.

A minor change to avoid getting a compiler error about functions
being ambiguous when the rectangle is used with floating point
vectors.

Added a missing const keyword.

Added some comments to clarify what exactly is a valid loss function.

The deserialize() for std::string was written under the assumption that std::string
doesn't store it's data in a contiguous block.  However, that isn't quite the case.
See this discussion:
http://stackoverflow.com/questions/1986966/does-s0-point-to-contiguous-characters-in-a-stdstring

Anyway, I changed deserialize() for std::string to be more efficient and read
directly into the string rather than into a contiguous buffer and then do a copy.

A minor usability improvement, I defaulted the feature_vector_type_
to matrix_type.

Cleaned up tests and added some additional ones.

A minor optimization.

Fixed grammar.

Added the max_sum_submatrix() function.

Changed the config_reader object so you don't have to say config_reader::kernel_1a
anymore to declare it.  Now you just say config_reader.

Changed the base64 object so you don't have to say base64::kernel_1a anymore to
declare it.  Now you just say base64.

You can now declare byte_orderer by saying just byte_orderer rather than
byte_orderer::kernel_1a.

Added a unit test for the byte orderer component

Changed the pipe so you don't have to say pipe<type>::kernel_1a anymore.  Now you
just say pipe<type>.

Changed the crc32 object so you don't have to say crc32::kernel_1a anymore to
declare it.  You just say crc32.  I also added some unit tests for it as well
as a few minor convenience functions.

Made it so you can reset a console_progress_indicator and use
it more than once.

The last commit left something in checking (i.e. _c mode).
Just switching it back to non-checking mode.

Added a missing requires clause to the get_sum_of_area() function
in the integral_image.  I also made the integral_image work
with signed pixel types.

Modified the probabilistic() trainer adapter (and the train_probabilistic_decision_function() routine)
so that they work with objects which have an interface compatible with std::vector rather than strictly
just std::vector objects.  For example, random_subset_selector objects can be used (as was the case in
some previous versions of dlib).

Added a value_type to the random_subset_selector so that it is more compatible
with the std::vector interface.

Fixed a compile time error that happens on debian's gcc 4.1.2

fixed grammar

minor change to avoid compiler warning in visual studio.

Added a unit test for the new svm_multiclass_linear_trainer.

Filled out spec and cleaned up code.

Added some missing DLIB_ASSERT statements.

Moved the new multiclass svm trainer into dlib.  Still need to clean up the code
and setup the abstract file.

Fixed compile time error

improved spec

updated spec

Fixed grammar

Added a structural SVM solver.

Minor cleanup, I removed unnecessary code.

Removed inappropriate uses of const on the be_verbose() functions.

Added some more tests for the max_cost_assignment() function.

Minor change to avoid a compiler warning in gcc.

Added the multiclass_linear_decision_function object.

It occurred to me that in some cases it is very easy to end up with dense vectors
which are slightly smaller than their corresponding sparse vectors.  So I changed
the requires clause of the dot(sparse,dense) and dot(dense,sparse) functions to not
require that the dense vector's size > sparse vector's size.  Now any combination
of sizes is legal.

Renamed assign_dense_to_sparse() to assign() and made it capable of also
assigning from sparse to sparse.

Clarified spec.

Added a dot() function which can dot a sparse vector with a dense vector.

This change is mainly about adding a result_type typedef to the various function objects.
Prior to this change, different function objects declared their return type in different ways,
now this has all been reconciled.  Now they all declare it as a public typedef named result_type.

I also simplified the cross_validate_multiclass_trainer(), cross_validate_trainer(),
test_binary_decision_function(), and test_multiclass_decision_function().  They now always
return double matrices regardless of any other consideration.

Added some tests for the LIBSVM formatted data IO functions
and related routines.

Added the fix_nonzero_indexing() function.

made test more robust

Simplified the oca implementation slightly.  It no longer keeps track of the
best point seen so far.  This change will allow me to use the optimizer in conjunction
with methods for quickly approximating subgradients and risk values without needing
to worry about the optimizer permanently fixating on what it erroneously thinks
is the best point.  Now the optimizer will just keep solving the cutting plane
subproblem and will use that solution as the current iterate and best known
solution.

Renamed max_index_value_plus_one() (a function for working with graphs) to
max_index_plus_one() so that it uses the same name as the essentially identical
function for working with sparse vectors.

Moved some functions for dealing with sparse vectors out of the svm_c_linear_trainer
implementation and into the sparse_vector.h header.  These are the add_to(), subtract_from(),
and max_index_plus_one() functions.

Added a value_type typedef to matrix_exp so it's easier to write templates
which operate on STL containers and matrix objects.

Removed some old comments

Fixed a bug in the kernel_matrix() function.  It didn't compile when used with
sparse samples which were of type std::vector<std::pair<> >.  Moreover, some of
the trainers have a dependency on kernel_matrix() so this fix makes those trainers
also work with this kind of sparse sample.

Added an is_pair template for telling if a type is a std::pair object.

Fixed a bug in load_libsvm_formatted_data().  Forgot to clear the contents
of the labels output vector before adding the loaded label data.

Fixed typo in spec

Changed the oca optimizer so that it warm starts the QP subproblem
rather than resolving it from scratch during each iteration. This
improves the speed and stability of the algorithm.

Changed code slightly to avoid a warning from gcc.

Made max_cost_assignment() take a matrix expression rather than an actual matrix.

Fixed bug in assert.

Added an implementation of the Hungarian algorithm for solving the optimal
assignment problem (in the new max_cost_assignment() routine).

Fixed typo in comment.

Fixed a problem which prevented the any_function unit test from compiling in visual studio 2008.

Added a test for split()

Added a function for splitting up strings which contain a sequence
of delimited tokens.

Added a unit test for the any_function.

Fixed a bug in any_function which prevented the .get() function
from compiling.

Made the is_function template work with functions of up to 10 arguments.
Previously it only worked up to 5 arguments.

Fixed a typo in the spec.

Added overloads of all the GUI event handlers so that now you can
use general functions as callbacks (via any_function).  This way,
if you have a C++0x compiler, you can use lambda functions with the
event handlers.

Switched the event handlers in the gui_widgets from member_function_pointers
to any_functions.

Fixed a typo in the spec for the is_empty() functions.  I also added an
is_set() to the any_function so that it's interface is similar to the
member_function_pointer.

Added a factory function to easily create temporary member function pointers.

Added an any_function which supports the same functionality as std::function from the
upcoming C++0x standard.  I added this so dlib can be modified to easily support lambda
functions while still being compilable on compilers which don't support the new
std::function.

Added tests for the new features of the distance_function object.

Fixed a runtime bug in the distance_function's + and - operators which triggered when
distance_functions with no basis vectors in them were added or subtracted.

Made the interface to the approximate_distance_function() a little cleaner and
improved its specification a bit.

Refactored the code in the reduced_decision_function_trainer2.  Part of it has been turned into
a global function called approximate_distance_function() which performs the main optimization.  The
reduced_decision_function_trainer2 now depends on this global function.  This changes makes this
function optimizer available for other purposes besides use in the reduced_decision_function_trainer2
object.

Improved the distance_function object by turning it into a properly encapsulated class
rather than just a simple struct.  I also added overloaded +, -, *, and / operators
for this object so you can do the kind of arithmetic you would expect on an object
which represents a point in a vector space.  This breaks backwards compatibility
with the previous interface though as the member variables are now private.

Fixed a few more compile time errors when dlib is compiled with clang.

I made some minor changes in a few places so that dlib compiles with the
clang compiler.

The any unit test was broken in a way which prevented it from actually running.
This has been fixed.

Applied a patch from Nils Labugt which fixes a bug in the gui_core component (Bug ID: 3171720).
The bug details are below:
    dlib GUI applications don't work anymore after I upgraded to Ubuntu 10.10 (AMD64). They
    consistently crash in base_window::set_title. XwcTextListToTextProperty returns
    XLocaleNotSupported instead of initializing 'property', but dlib ignores the return value,
    resulting in a crash in XLib when XSetWMName is called with garbage input or when
    property.value is XFreed without having been allocated.

Fixed a bug in an assert

Fixed errors in the spec

Fixed some comments.

Fixed the typo in the last commit which prevented compilation when ENABLE_ASSERTS
was defined.

Refactored the krr_trainer into two objects.  A rr_trainer which just does
linear ridge regression and the krr_trainer which uses the empirical_kernel_map
to do non-linear ridge regression.  No changes were made to the behavior of the
krr_trainer.  This update is just to allow the use of linear ridge regression
without a superfluous empirical_kernel_map running at the beginning of the training
process.

Adding a copy of the krr_trainer that will be just for use with linear kernels.

Added an overloaded operator/ to allow you to say things like 3.0/my_matrix

Removed the requirement that the lisf be non-empty when used to load an
EKM.  Instead, the load() function now will accept non-empty lisf objects
and throw a non-fatal exception.  This behavior should be slightly less
surprising to users, especially since certain degenerate datasets can give
rise to empty lisf objects when you might not expect it.

Minor fix to avoid a compile time error when using the kernel_matrix() function.

Updated the image_display widget so that you can zoom in and out using the mouse wheel.

Made test more robust

clarified a comment

Added wrappers for the new overloads which take std::string.

Added overloads to the config_reader's methods to allow it to load directly from
a file name given as a string in addition to taking istream objects.

Accidentally removed a needed #include yesterday.  Just putting it back.

Removed the ASSERT that the B matrix be symmetric since compiler optimizations
can sometimes cause B to be very slightly non-symmetric.

Added a comment

All I did in this change was rename memory_manager<char>::kernel_1a to default_memory_manager.
default_memory_manager is way more readable and clear.