FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

Post on 19-Jan-2017

160 views 2 download

Transcript of FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

www.filemaker-konferenz.com

Every time a new version of the FileMaker platform is released you have to make the decision when it is safe to upgrade and what changes you have to prepare for. One of the areas to consider is performance. To make it easier for you to get ready for the upgrade to FileMaker 15, HOnza and his team have tested the performance of the new version and compared it to the versions 12, 13, and 14 running under the same conditions. Not surprisingly, some things have become faster and some have become slower. Learn the freshest test results, so that you can make well informed decisions about your own projects.

FileMaker 15 Performance Test Results

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• Co-founder and co-owner of 24U Software,FBA Platinum Member

• Developing FileMaker solutions since 1991

• FileMaker 8, 10, 11, 12, 13, 14, and 15Certified Developer

• Winner of the FileMaker DevCon 2015 Developer Cup

• FileMaker Mad Dog Award 2011 winner

• Mad Optimizer and achiever of the impossible…

• Vendor session speaker at FileMaker DevCon, spoke at Pause[x]London and Pause[x]Berlin, and remotely at PauseOnError Portland

HOnza Koudelka

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• Mac Pro (early 2008)

• 2 x 2,8 GHz Intel Xeon

• 8 GB RAM

• Separate hard drive for data

• Mac OS X 10.11.6 El Capitan

• Windows Server 2012 R2

• MacBook Pro 15” mid 2012 as client for WAN testing

• VDSL 20Mbps/2Mbps for WAN testing

• FileMaker Server versions 14, 15v1, 15v2

• FileMaker Pro Advanced 12, 13, 14, 15v1, 15v2

Test Equipment

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• Updated WhatIsFaster.fmp12 originally created for FileMaker DevCon 2013

• Automated test scripts running at least three times with the same test data

• Unattended computer with disabled screensaver and energy saver

• Perform Script On Server for server performance testing

• Random generated data o different types and sizes (except for containers)

• Random substrings from a 297840 characters long “Lorem Ipsum” test text

Test Solution

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• Export Records as tab delimited text

• Import Records from tab delimited text

• Sort Records

• by indexed field

• by unindexed field

• Perform Find

• indexed vs unindexed field

• small vs large result found set

• Position vs PatternCount

• Replace Field Contents vs Looped Set Field

• Summary fields vs Aggregate functions vs ExecuteSQL

• Delete All Records, Truncate Table, Delete All Found Records (leaving one record)

• Popup vs Dropdown rendering

What was tested

4385tests

this week

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• Multiple users

• Multiple concurrent tasks

• Working with container fields

• Exact amounts of data transferred between client and server

• FileMaker Go

• FileMaker WebDirect

• XML / PHP / ODBC / JDBC connections

• Two-machine deployment

• FileMaker Server with enabled SSL

• Server-side schedules, including backup schedules

• Different cache sizes and other configuration differences

What was NOT tested

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

What does FAST look like?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Which Pro Advanced is the fastest?

12 13 14 15v115v2

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

What has become faster?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Same speed since FileMaker 13

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

What has become slower?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

What has become slower?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

The biggest surprise

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Test I did for FileMaker DevCon 2016

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Test I did for FileMaker DevCon 2016

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• All tests conducted for FileMaker Konferenz worked with up to 100 000 records

• Test done for FileMaker DevCon worked with 1 000 000 (1 million) records

• In both cases I was only modifying 5 000 records

Error or shocking truth?

Let’s do some more testing!

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

One more thing…

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Which FileMaker Server?

14 15v1 15v2

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

What has become faster?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

What has become slower?

Nothing noticeablewith the test dataand environment

I have used

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

The biggest surprise

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• FileMaker Developer since FileMaker II

• Former trials rider

• Mechanical engineer

• Inventor of the Virtual List technique

Bruce Robertson

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Game Changer for Virtual List

FM14 w/o VL

FM14 w/ VL

FM15 w/o VL

FM15 w/ VL

Load

local

record

data

Populate

portal

Interact

with

layout

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• Some things remained equally fast

• Some things became faster

• Some things became slower

• Something new could become a bottleneck in your solution

Conclusion

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

So, should I upgrade or not?

What’s your solution’s bottleneck?

Is it slower in 15?

Upgrade

Optimize No

Yes

Applies if performance is your main or the only concern

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Brain Exercise

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Client or Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Client or Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Client or Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Client or Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Client or Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

When to use Perform Script on Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

When to use Perform Script on Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

When to use Perform Script on Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

When to use Perform Script on Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

When to use Perform Script on Server?

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Found Count vs Total Record Count

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Found Count vs Total Record Count

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Found Count vs Total Record Count

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Field indexing

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Sort Records

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Perform Find

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• This presentation as PDF

• Recording of this session

• The Test Solution I used (WhatIsFaster.fmp12)

• Test Results Database with all 4 385 test results & chart generator

• Modified version of 24U FM Bench with my DevCon 2016 reports

Available after the conference

I will appreciate if you conduct your own tests

and send me your results to

honza@24uSoftware.com

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

• FileMaker Community > Discussions > Performance

• FileMaker DevCon Session Recordings (available on YouTube)

• Performance related sessions

• Under the Hood sessions

• FM Academy & Skeleton Key webinars (FMAcademy.com)

• “Designing for WAN Peformance”

• FileMaker Optimizers LinkedIn Group (FMOptimizers.com)

• 24U FM Bench (FMBench.com)

• Big-O Cheat Sheat (bigocheatsheet.com)

• A Gentle Introduction to Algorithm Complexity Analysis (discrete.gr/complexity/)

More resources

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

Vortrag und Sprecher

Vielen Dank unseren Sponsoren

Danke für das Bewerten dieses Vortrages