FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

7. FileMaker Konferenz | Salzburg | 13.-15. Oktober 2016

www.filemaker-konferenz.com

Every time a new version of the FileMaker platform is released you have to make the decision when it is safe to upgrade and what changes you have to prepare for. One of the areas to consider is performance. To make it easier for you to get ready for the upgrade to FileMaker 15, HOnza and his team have tested the performance of the new version and compared it to the versions 12, 13, and 14 running under the same conditions. Not surprisingly, some things have become faster and some have become slower. Learn the freshest test results, so that you can make well informed decisions about your own projects.

FileMaker 15 Performance Test Results

http://www.filemaker-konferenz.com


Vortrag und Sprecher

• Co-founder and co-owner of 24U Software,FBA Platinum Member

• Developing FileMaker solutions since 1991

• FileMaker 8, 10, 11, 12, 13, 14, and 15Certified Developer

• Winner of the FileMaker DevCon 2015 Developer Cup

• FileMaker Mad Dog Award 2011 winner

• Mad Optimizer and achiever of the impossible…

• Vendor session speaker at FileMaker DevCon, spoke at Pause[x]London and Pause[x]Berlin, and remotely at PauseOnError Portland

HOnza Koudelka



• Mac Pro (early 2008)

• 2 x 2,8 GHz Intel Xeon

• 8 GB RAM

• Separate hard drive for data

• Mac OS X 10.11.6 El Capitan

• Windows Server 2012 R2

• MacBook Pro 15” mid 2012 as client for WAN testing

• VDSL 20Mbps/2Mbps for WAN testing

• FileMaker Server versions 14, 15v1, 15v2

• FileMaker Pro Advanced 12, 13, 14, 15v1, 15v2

Test Equipment



• Updated WhatIsFaster.fmp12 originally created for FileMaker DevCon 2013

• Automated test scripts running at least three times with the same test data

• Unattended computer with disabled screensaver and energy saver

• Perform Script On Server for server performance testing

• Random generated data o different types and sizes (except for containers)

• Random substrings from a 297840 characters long “Lorem Ipsum” test text

Test Solution



• Export Records as tab delimited text

• Import Records from tab delimited text

• Sort Records

• by indexed field

• by unindexed field

• Perform Find

• indexed vs unindexed field

• small vs large result found set

• Position vs PatternCount

• Replace Field Contents vs Looped Set Field

• Summary fields vs Aggregate functions vs ExecuteSQL

• Delete All Records, Truncate Table, Delete All Found Records (leaving one record)

• Popup vs Dropdown rendering

What was tested

4385tests

this week



• Multiple users

• Multiple concurrent tasks

• Working with container fields

• Exact amounts of data transferred between client and server

• FileMaker Go

• FileMaker WebDirect

• XML / PHP / ODBC / JDBC connections

• Two-machine deployment

• FileMaker Server with enabled SSL

• Server-side schedules, including backup schedules

• Different cache sizes and other configuration differences

What was NOT tested



What does FAST look like?



Which Pro Advanced is the fastest?

12 13 14 15v115v2



What has become faster?



Same speed since FileMaker 13



What has become slower?



The biggest surprise



Test I did for FileMaker DevCon 2016



• All tests conducted for FileMaker Konferenz worked with up to 100 000 records

• Test done for FileMaker DevCon worked with 1 000 000 (1 million) records

• In both cases I was only modifying 5 000 records

Error or shocking truth?

Let’s do some more testing!



One more thing…



Which FileMaker Server?

14 15v1 15v2



What has become faster?



What has become slower?

Nothing noticeablewith the test dataand environment

I have used



The biggest surprise



• FileMaker Developer since FileMaker II

• Former trials rider

• Mechanical engineer

• Inventor of the Virtual List technique

Bruce Robertson



Game Changer for Virtual List

FM14 w/o VL

FM14 w/ VL

FM15 w/o VL

FM15 w/ VL

Load

local

record

data

Populate

portal

Interact

with

layout



• Some things remained equally fast

• Some things became faster

• Some things became slower

• Something new could become a bottleneck in your solution

Conclusion



So, should I upgrade or not?

What’s your solution’s bottleneck?

Is it slower in 15?

Upgrade

Optimize No

Yes

Applies if performance is your main or the only concern



Brain Exercise



Client or Server?



When to use Perform Script on Server?



Found Count vs Total Record Count



Field indexing



Sort Records



Perform Find



• This presentation as PDF

• Recording of this session

• The Test Solution I used (WhatIsFaster.fmp12)

• Test Results Database with all 4 385 test results & chart generator

• Modified version of 24U FM Bench with my DevCon 2016 reports

Available after the conference

I will appreciate if you conduct your own tests

and send me your results to

[email protected]

mailto:[email protected]



• FileMaker Community > Discussions > Performance

• FileMaker DevCon Session Recordings (available on YouTube)

• Performance related sessions

• Under the Hood sessions

• FM Academy & Skeleton Key webinars (FMAcademy.com)

• “Designing for WAN Peformance”

• FileMaker Optimizers LinkedIn Group (FMOptimizers.com)

• 24U FM Bench (FMBench.com)

• Big-O Cheat Sheat (bigocheatsheet.com)

• A Gentle Introduction to Algorithm Complexity Analysis (discrete.gr/complexity/)

More resources

http://FMAcademy.com

http://FMOptimizers.com

http://FMBench.com

http://bigocheatsheet.com

http://discrete.gr/complexity/



Vielen Dank unseren Sponsoren

Danke für das Bewerten dieses Vortrages

FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results

Presentations & Public Speaking

Transcript of FMK2016 - Honza Koudelka - FileMaker 15 Performance Test Results