3.0.0 (2018-11-02) ↑

2.2.10 (2018-03-18) ↑

2.2.9 (2018-02-03) ↑

2.2.8 (2017-09-26) ↑

2.2.7 (2016-12-21) ↑

2.2.6 (2016-10-04) ↑

2.2.5 (2016-9-23) ↑

2.2.4 (2016-9-21) ↑

2.2.3 (2016-6-25) ↑

2.2.2 (2016-5-30) ↑

2.2.1 (2016-4-5) ↑

2.2.0 (2016-3-26) ↑

2.1.2 (2016-2-20) ↑

2.1.1 (2016-1-15) ↑

2.1.0 (2016-1-19) ↑

Add ability to define test alternatives with custom probabilities, #283. (@peterkovacs) Allow ActiveRecord model metrics to provide their own identity source, #285. (@peterkovacs) Add individual cookie options for name, domain, path, secure, and httponly properties of the cookie in the `Vanity.configuration`, #282. (@peterkovacs) Update default_request_filter to exclude more bots, #284. (@peterkovacs) Remove testing support for ruby 1.9.3. (@phillbaker) Remove testing support for rails 4.0. (@phillbaker) Add attr_accessible for VanityConversion model alternative attribute (@mikem836)

2.0.0 (2015-12-14) ↑

Extract configuration from Vanity::Playground to Vanity::Configuration (@phillbaker) Remove `track!` and `ab_test` from the global scope, they're now available on the `Vanity` module. (@phillbaker) Reduce test frameworks to just minitest (@phillbaker) Replace deprecated ActiveRecord finders (@bogdan-dumitru, @leematos, @aaronjensen) Add date to vanity_metric_values index (@aaronjensen) Fix insecure wildcard route (@modosc) Introduce Ruby 2.2 support. (@sebjacobs) Added support for testing against jruby. (@Matt343) Adding internationalization to reports (@teonimesic) Allow Rails applications to override default views (@rsslldnphy) Add support to reset experiments (@davidguthu)

1.9.0 (2014-04-20) ↑

Include db:reset in blacklist for autoconnect. (@phillbaker) Add grace period to Vanity::Metric updated_at (@stangel) Add timestamps to vanity_participants (@inkredabull) Use sqlite3 for all active record adapter tests & updates to test tasks (@phillbaker) Fix ActiveRecord participant retrieval with non-primitive identities. (@phillbaker) Replace instance variables with locals to fix CLI. (@phillbaker) Replace js encoding with server-side call. (@phillbaker)

1.9.0 (2014-01-18) ↑

Change order of preference for vanity identity, from highest to lowest: URL param, cookie, method call, assignment. (@phillbaker) Add Playground#request_filter for AbTest#choose(s) (@phillbaker) Call on_assignment and perform rebalance when using js (@tmandry) Add Adapter#experiment_persisted? and check before showing Dashboard. (@phillbaker) Show info message at top of report if not collection (@hellochar) Add gracefull failover when redis is down/unreachable. (@phillbaker) Update README and documentation for clarity. (@nextmat) Remove hard Redis gem dependency from gemspec. (@phillbaker) Update appraisal to v1.0.0. (@phillbaker)

1.8.3 (2013-11-20) ↑

Add support for Rails 4. (@phillbaker) Update redis gem depedendencies. (@phillbaker) Add Bayesian multi-armed bandit scoring for experiments as an alternative to the standard A/B calculations, as well as periodic alternative rebalancing based on alternative performance (@lotze). Add 'complete' UI functionality to the dashboard to complete an experiment from the rails web interface (@lotze). Gem maintenance: license specification to gemspec, remove .rvmrc file (@phillbaker). Add ab_assigned to adapters: to get an array of the experiments a specific identity is assigned to, as well as a controller action to display those assignments (@lotze).

1.8.2 (2013-10-27) ↑

Optimize metric_values query (@zawaideh). Add an on_assignment hook for experiments which is called when an identity is given an assignment in ab_test (@lotze) Finish Ruby 2.0 compatiblity with testing setup and add ActionMailer test coverage (@phillbaker).

1.8.1 (2013-10-05) ↑

Added vanity_experiments helper for rails to return read only copy of active experiments (@iceberg901). Fixed support for Mass Assignment on Rails 3.2 (@hcarver). Fixed commandline usage (@phillbaker).

1.8.0 (2012-03-12) ↑

Improved support for Rails 3.1 and Rails 3.2. Thanks to masverba, Daan and IsaacLewis.

Finer Grained Exceptions for Missing Experiments (Nick Barnwell)

1.7.1 (2011-09-30) ↑

Minor change in locating config file (Ariel Salomon)

Allow for table names in specified :timestamps (Peter Kovacs)

When a named scope includes a join, created_at can be ambiguous. Use

metric "Sky is limit" do
  model Sky, :timestamp => 'skies.created_at'
end

to disambiguate.

Make vanity_identity method private on controller; ensure no default route (Ariel Salomon)

Add Rails 2.3-compatible generator (Ariel Salomon)

Lazy Playground initialization for rails 3.1 (Jonathan del Strother)

Update documentation to reflect that host, port, and database options for redis connections are deprecated in favor of using the connection option with a URI (Patrick Joyce)

1.7.0 (2011-08-27) ↑

1.7.0 adds support for ActionMailer, for example:

class UserMailer < ActionMailer::Base
  def invite_email(user)
    use_vanity_mailer user
    mail :to => user.email, :subject => ab_test(:invite_subject)
  end
end

See the documentation for more details.

With 1.7.0 and moving forward, if you need to setup a database schema (relational databases only), please use the generator:

$ rails generate vanity
$ rake db:migrate

Rails generator for AR migrations (Zaid Zawaideh)

A/B testing in ActionMailer (Joseph Sofaer)

Fix hung passenger processes when using Redis client (Chris Griego)

1.6.1 (2011-07-20) ↑

Fixed cookie domain setting.

1.6.0 (2011-07-18) ↑

If robots or spiders make up a significant portion of your sites traffic they can affect your conversion rate. Vanity can optionally add participants to the experiments using asynchronous JavaScript callbacks, which will keep almost all robots out. To set this up simply do the following:

  1. Vanity.playground.use_js!

  2. Set Vanity.playground.add_participant_path = '/path/to/vanity/action'

  3. Add <%= Vanity.vanity_js %> to the bottom of any view that needs to set up an ab_test

Fix for metrics on rails 3 models (Esteban Pastorino).

Use JavaScript to report participants, useful for ignoring bots on publicly accessible pages (Doug Cole).

AbTest#choose returns an Alternative rather than just the value (Doug Cole).

Add warnings instead of swallowing errors (Anthony Eden).

Fixing broken test for mongodb adapter (Joshua Krall).

Fix returning correct experiment when in test mode and manually set via chooses (Ryan Sonnek).

Don't round the conversion rate before using it, it affects the test results, making them less accurate (Doug Cole).

Fixed loading config from yml when using other than redis adapter (Arttu Tervo)

Default to localhost unless host in config file (Arttu Tervo)

Fixed mongo connection adapter connect! when called after disconnect! (Arttu Tervo)

Use mongo replica set connection if multiple hosts were given in YAML configuration file (Arttu Tervo)

Cookie domain from rails configuration (Arttu Tervo)

Add bson_ext to Gemfile to load C extension for mongodb ruby driver, and prevent Notice messages as the tests run (tenaciousflea)

Update redis-namespace dependency to 1.0 (Ville Lautanala)

1.5.3 (2011-04-11) ↑

Added number of participants and number of converted participants to ab_test template (Avishai Weiss).

1.5.2 (2011-04-11) ↑

Fixed to work with redis-rb 2.2.0 (Kevin Menard).

Fixed to work with Postgresql: it complained that the index names generated by add_index were too long, so I gave them shorter names (Robert Rasmussen).

Fixed SQL errors comparing an int to a varchar column, and no “as” on a column alias (Robert Rasmussen).

Fixed auto-escaped text in the experiment template that I marked as html_safe (Robert Rasmussen).

Added some Rails 3.x documentation to the 2-minute demo instructionsa (Andy Atkinson).

Fix to set collecting flag from vanity.yml config file.

1.5.1 (2010-12-20) ↑

Fixes some minor bugs in RoR when including the Dashboard (netguru)

1.5.0 (2010-10-23) ↑

Note: MongoDB URI scheme changed from mongo: to mongodb: to be consistent with the rest of the civilized world. If you get an error because Vanity can't find the MongoDB adapter, fear not! It's still there, just need to update your config/vanity.yml file.

Rails 3 support (Adam Keys, Stephen Celis, Brian Leonard, Ryan Carver)

Changed MongoDB URI scheme from 'mongo://' to the standard 'mongodb://' and renamed the mongodb adapter filename to make it match (JS Boulanger)

Added support for ERB in YAML configuration files (JS Boulanger)

Fixed initialization of playground's Rails defaults such that they can be overriden in the environment (JS Boulanger)

1.4.0 (2010-08-06) ↑

Note: Run this command to upgrade your database to 1.4, or you will not have access to collected metrics and experiment data:

vanity upgrade

Connection adapters! We have a new way for managing connections which extends to multiple adapters (not just Redis). The easiest is to use the configuration file config/vanity.yml. For example:

development:
  adapter: redis
production:
  adapter: mongodb

We get to keep Redis, add new MongoDB adapter, but lose Mock. It's still there, but there's a new way to use Vanity outside production: you can turn data collection on/off.

Under Rails, data collection is turned off in all environments except production. To turn if on/off:

Vanity.playground.collecting = true/false.

This release switches to latest Redis gem and uses redis-namespace (what took me so long?) If your own code relies on the Redis gem, watch out: there are some subtle incompatibilities between 1.x and 2.x.

Now using RVM, gemsets and Bundler to test Vanity in different configurations. To run the full set of tests in all the supported versions of Ruby:

rake test:rubies

To test specific version of Ruby:

rake test:rubies[1.8.7]

To switch around:

rvm 1.9.2@vanity

Vanity::Adapters::RedisAdapter.

production environment. When false, disables collecting of metric and experiment data.

future.

connection and establish_connection instead.

1.3.0 (2010-03-01) ↑

This release adds support for Google Analytics, AdWords and forking servers (Passenger, Unicorn).

To view Google Analytics metrics from within Vanity, first make sure you are using Garb. For example, in your Gemfile:

gem "vanity", "1.3.0"
gem "garb",   "0.5.0"

Next, authenticate using your account credentials. For example, in your config/environments/production.rb:

require "garb"
Garb::Session.login('..email..', '..password..', account_type: "GOOGLE") rescue nil

Last, define Vanity metrics that tap to Google Analytics metrics. For example:

metric "Acquisition: Visitors" do
  description "Unique visitors on any given page, as tracked by Google Analytics"
  google_analytics "UA-1828623-6", :visitors
end

1.2.0 (2009-12-14) ↑

This release introduces metrics backed by ActiveRecord. Use them when your model is already tracking a metric, and you get instant historical data.

Example, track sign ups using User model:

metric "Signups" do
  model Account
end

Example, track satisfaction using Survey model:

metric "Satisfaction" do
  model Survey, :average=>:rating
end

Example, track only high ratings:

metric "High ratings" do
  model Rating, :conditions=>["stars >= 4"]
end

There's no need to call track! on these metrics.

1.1.1 (2009-12-4) ↑

1.1.0 (2009-12-4) ↑

This release introduces metrics. Metrics are the gateway drug to better software.

It’s as simple as defining a metric:

metric "Cheers" do
  description "They love us, don't they?"
end

Tracking it from your code:

track! :cheers

And watching the graph from the Dashboard.

You can (should) also use metrics with your A/B tests, for example:

ab_test "Pricing options" do
  metrics :signup
  alternatives 15, 25, 29
end

This new usage may become requirement in a future release.

Much thanks to Ian Sefferman for fixing issues with Ruby 1.8.7 and Rails support.

1.0.0 (2009-11-19) ↑

This release changes the way you define a new experiment. You can use a method suitable for the type of experiment you want to define, or call the generic define method (previously: experiment method). For example:

ab_test "My A/B test" do
  alternatives :a, :b
end

The experiment method is no longer overloaded: it looks up an experiment (loading its definition if necessary), but does not define an experiment. The ab_test method is overloaded, though this may change in the future.

In addition, the ab_goal! method is now track!. This method may be used for other tests in the future.

0.3.1 (2009-11-13) ↑

0.3.0 (2009-11-13) ↑

0.2.2 (2009-11-12) ↑

0.2.1 (2009-11-11) ↑

0.2.0 (2009-11-10) ↑