"... we'll shortly announce a major investment to improve our Frequent Flyer program"

[tdimdad]

But probably testing the layout of the live website before publishing the other changes.

They really should stand up a test environment for the workplace kids to play in. The last profits might allow some meagre funding for it.

 

[chol]

My wild guess is "Classic" has been added to the rewards icon to differentiate it from whatever the new reward availability will be called I.e. Classic vs. Bonus / Elite reward

 

[SYD]

My wild guess is "Classic" has been added to the rewards icon to differentiate it from whatever the new reward availability will be called I.e. Classic vs. Bonus / Elite reward

Unicorns?

 

[TheInsider]

They really should stand up a test environment for the workplace kids to play in. The last profits might allow some meagre funding for it.

They have been testing different versions of the website and booking pages for months now. Usually about 3-4 different versions at a time for a few weeks at a time. Whatever preforms best (in terms of sales, basket size etc etc) then goes live or will go live.

 

[SYD]

In the calendar view, yes that's true. Maybe the term still has some life left in it!

Not just calendar view - every view from what I can see.

IMHO, it looks like the people have spoken and they hate “ASA”* being the first thing you see and the ridiculous points required. Sure, if you really want to waste your points, pay with points at the end.

It’s only taken 10+ years to revert back!

*Oh, except the heady days of marginal points FASAs and JASAs!

 

[Guvner]

They have been testing different versions of the website and booking pages for months now. Usually about 3-4 different versions at a time for a few weeks at a time. Whatever preforms best (in terms of sales, basket size etc etc) then goes live or will go live.

so whatever performs best for Qantas, not the customer experience.

 

[elanshin]

so whatever performs best for Qantas, not the customer experience.

I wouldn't say that. If that was the case they would've kept point+pay exactly where it was.

 

[TheInsider]

so whatever performs best for Qantas, not the customer experience.

There is a correlation between both. Easier for things to be done. more likely to pay for the flight, even if it's a 1% difference.
Any changes are based on data.

 

[tdimdad]

They have been testing different versions of the website and booking pages for months now. Usually about 3-4 different versions at a time for a few weeks at a time. Whatever preforms best (in terms of sales, basket size etc etc) then goes live or will go live.

Are you saying that any variability we see on the site is IT or marketing doing behavioural testing on us? Do a controlled release of a feature or story and see how it flies.

 

[TheInsider]

Are you saying that any variability we see on the site is IT or marketing doing behavioural testing on us?

Don't know if it is marketing, more IT front end experience I assume.
Basic things like colours and button locations have changed frequently over the past few months.
Just like the icons on the fare page or the same area but 'blue' highlighting saying things like '5 or fewer seats left'.

 

[elanshin]

Don't know if it is marketing, more IT front end experience I assume.
Basic things like colours and button locations have changed frequently over the past few months.
Just like the icons on the fare page or the same area but 'blue' highlighting saying things like '5 or fewer seats left'.

In before the intern reviewing the data mistakes their change they made just before DSC as the reason sales spiked.

 

[TheInsider]

In before the intern reviewing the data mistakes their change they made just before DSC as the reason sales spiked.

TBH I don't even think it's QF reviewing the data, I think it could be some company like Deloitte or one of those places.

 

[elanshin]

TBH I don't even think it's QF reviewing the data, I think it could be some company like Deloitte or one of those places.

All the more likely it's some uni intern or first junior grad compiling the data.

 

[sudoer]

so whatever performs best for Qantas, not the customer experience.

Pretty standard A-B testing. More completed bookings can be a reflection of a smoother/quicker customer experience.

 

[Guvner]

I wouldn't say that. If that was the case they would've kept point+pay exactly where it was.

Altering a website layout, function or flow, and using any data variations as a measure of business improvement is so completely naive that I doubt even Qantas would do it. There are many 10’s of other factors involved.

 

[Guvner]

Pretty standard A-B testing. More completed bookings can be a reflection of a smoother/quicker customer experience.

Or season, or price, or external marketing or competition promotions or system availability …..choose whatever if it’s live data.

 

[sudoer]

Or season, or price, or external marketing or competition promotions or system availability …..choose whatever if it’s live data.

Season/promos/marketing don't factor in because the A/B versions are served simultaneously.

Visitors are randomly assigned one of two (or more!) versions. The recording of results starts and finishes for both versions at the same time so external factors are equal.

What is A/B testing? With examples

A/B testing is a method of comparing two versions of a webpage or app against each other to determine which one performs better. Learn all about it here!

www.optimizely.com

It's not like they are showing one version in January and one in February and then comparing the two.

The test can glean all sorts of useful data and is very common for UX work.

 

[p--and--t]

Season/promos/marketing don't factor in because the A/B versions are served simultaneously.

Visitors are randomly assigned one of two (or more!) versions. The recording of results starts and finishes for both versions at the same time so external factors are equal.

What is A/B testing? With examples

A/B testing is a method of comparing two versions of a webpage or app against each other to determine which one performs better. Learn all about it here!

www.optimizely.com

It's not like they are showing one version in January and one in February and then comparing the two.

The test can glean all sorts of useful data and is very common for UX work

Spot on.

No better way of testing the UI theory of internal “specialists” than putting it to the test with real customers in real time with real transactions and seeing the results, not opinions of either the staff, consultants or customer surveys.

 

[Guvner]

Thanks for the A/B lessons.
I guess I wasted my 25 years in the industry. Fortunately I pivoted across to Fed Government Cybersecurity Architecture consulting and am not providing UX advice to Qantas.
Given you believe Qantas (loosely termed to cover all their vendors) utilises an effective and formally recognised SDLC methodology I’ll step away from the conversation.

 

[sudoer]

Congratulations on your long and illustrious career but with all that experience under your belt, I would have expected you to know that..

season, or price, or external marketing or competition promotions or system availability

..does not have a substantial impact on A/B testing.

Altering a website layout, function or flow, and using any data variations as a measure of business improvement is so completely naive that I doubt even Qantas would do it.

Do you think the concept of data-driven decision making has no merit?