Adopting New Trackpad Features

Adopting New Trackpad FeaturesMastering the force

Master Raleigh Ledet AppKit Engineer

App Frameworks

Session 217

#WWDC15

Force Touch Trackpad

Force sensor

Taptic Engine

Force sensor

Taptic Engine

Force sensor

Taptic Engine

Force sensor

Taptic Engine

Force sensor

Taptic Engine

Force Click

Training ScheduleBecoming a master in one day!

Squire• Accelerator Controls, Table Row Actions

Knight• Force Event Stream, Spring Loading, Alignment Feedback

Master• Configuration and Haptics

SquireUsing the built-in tools

Squire Training ScheduleUsing the built-in tools

Table Row Actions Spring Loaded ControlsAccelerator Controls

Table Row ActionsCase Study: Mail message list

NSTableViewDelegate optional func tableView(NSTableView, rowActionsForRow: NSInteger, edge: NSTableRowActionEdge) -> [NSTableViewRowAction]

.Leading

.Trailing

NSTableViewRowAction convenience init(style: NSTableViewRowActionStyle, title: String, handler: ((NSTableViewRowAction, Int) -> Void))

.Regular

.Destructive

Spring Loaded ControlsCase Study: Finder Drag and Drop Navigation

NSButton

var springLoaded: Bool

NSButton

NSSegmentedControl

Accelerator ControlsCase Study: Quicktime Player

NSButton

func setButtonType(NSButtonType) .AcceleratorButton .MultiLevelAcceleratorButton

NSButton

var doubleValue: Double Range: 0,[1-2]

NSButton

var doubleValue: Double Range: [0-5]

var maxAcceleratorLevel: Int Range: [1-5]

NSButton

var doubleValue: Double Range: [0-5]

var maxAcceleratorLevel: Int Range: [1-5]

NSButton

var doubleValue: Double

0 1 2 3 4 5

1X 2X 5X 10X 30X 60x

Accelerator ControlsCase Study: Maps

NSSegmentedControl

var trackingMode: NSSegmentSwitchTracking .MomentaryAccelerator

NSSegmentedControl

func doubleValueForSelectedSegment() -> Double Range: 0,[1-2]

Accelerator ControlsCase Study: Photos

NSControl

var continuous: Bool

Accelerator ControlsCase Study: Photos

NSControl

var continuous: Bool

Accelerator ControlsNSButton, NSSegmentedControl

Accelerated

Continuous

Maps: +/- zoom buttons

Photos: previous / next photo button

Accelerated

Continuous

Accelerated

Continuous

Accelerated

Continuous

Squire SummaryUsing the built-in tools

Table Row Actions Spring Loaded ControlsAccelerator Controls

KnightUnderstanding how the force flows

Knight Training ScheduleUnderstanding how the force flows

Force event streamSpring loading protocolAlignment feedback

Event Stream

NSLeftMouseDown

NSLeftMouseDragged

NSLeftMouseUp

NSKeyUp

NSKeyDown

NSRightMouseDown

NSRightMouseDragged

NSRightMouseUp

NSMouseEntered

NSMouseExited NSFlagsChanged

NSScrollWheel

NSEventTypeMagnify

NSEventTypeRotate

Event StreamPressure Gesture

NSLeftMouseDown

NSLeftMouseDragged

NSLeftMouseUp

NSKeyUp

NSKeyDown

NSRightMouseDown

NSRightMouseDragged

NSRightMouseUp

NSMouseEntered

NSMouseExited NSFlagsChanged

NSScrollWheel

NSEventTypeMagnify

NSEventTypeRotate

NSEventTypePressure

NSLeftMouseDownMask

NSLeftMouseDraggedMask

NSLeftMouseUpMask

NSKeyUpMask

NSKeyDownMask

NSRightMouseDownMask

NSRightMouseDraggedMask

NSRightMouseUpMask

NSMouseEnteredMask

NSMouseExitedMask NSFlagsChangedMask

NSScrollWheelMask

NSEventMaskMagnify

NSEventMaskRotate

NSEventMaskPressure

NSLeftMouseDraggedMask NSLeftMouseUpMask NSEventMaskPressure, ,

trackEventsMatchingMask(NSEventMask,…)

[.LeftMouseDraggedMask, .LeftMouseUpMask, .EventMaskPressure]

func pressureChangeWithEvent(NSEvent)

[.LeftMouseDraggedMask, .LeftMouseUpMask, .EventMaskPressure]

NSEventTypePressure NSEventMaskPressure var phase: NSEventPhase { get } .Began -> .Changed -> .Ended

NSEventTypePressure NSEventMaskPressure var phase: NSEventPhase { get } var stage: Int { get }

1 - click

1 - click 2 - force click

1 - click 2 - force click 0 - gesture release

Stage 1

NSEventTypePressure

var pressure: Float { get } (of the current stage) Range: [0-1]

NSEventTypePressure

2Stage 1

NSEventTypePressure

2Stage 1

NSEventTypePressure

var pressure: Float { get } var stageTransition: CGFloat { get } Range: [0-1]

2Stage 1

NSEventTypePressure

2Stage 1

NSEventTypePressure

2Stage 1

User Action

Stage:

Mouse:Events

Event StreamParallel Mouse and Pressure event streams

Click threshold

Force Click threshold

User Action

Stage:

Mouse:Events

Click threshold

User Action

Stage:

Mouse:Events

Click threshold

User Action

Stage:

Mouse:Events

Click threshold

User Action

Stage:

Mouse:Events

Click threshold

Stage:

Mouse:

Click threshold

Events

User Action

Stage:

Mouse:

Click threshold

Events

User Action

Click threshold

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged

Stage:

Mouse:Events

User Action

Click threshold

Dragged Move

Stage:

Mouse:Events

User Action

Click threshold

Dragged Move

Stage:

Mouse:Events

User Action

var associatedEventMask: NSEventMask { get }

if ((mouseDown.associatedEventMask.contains(.EventMaskPressure)) { // Pressure Capable Device! }

Event StreamSummary

NSEventTypePressure NSEventMaskPressure var phase: NSEventPhase { get } var pressure: Float { get } var stage: Int { get } var stageTransition: CGFloat { get } var associatedEventMask: NSEventMask { get }

func pressureChangeWithEvent(NSEvent)

Spring Loading

@protocol NSSpringLoadingDestination

Spring Loading

@protocol NSSpringLoadingDestination required (One of these) func springLoadingEntered(NSDraggingInfo) -> NSSpringLoadingOptions

- and / or - func springLoadingUpdated(NSDraggingInfo) -> NSSpringLoadingOptions

Spring Loading

.Disabled

.Enabled

Spring Loading

.Disabled

.Enabled

.ContinuousActivation

Spring Loading

.Disabled

.Enabled

.ContinuousActivation

.NoHover

Spring Loading

@optional func springLoadingExited(NSDraggingInfo) func draggingEnded(NSDraggingInfo)

Spring Loading

@protocol NSSpringLoadingDestination @required func springLoadingActivated(Bool, draggingInfo: NSDraggingInfo) func springLoadingHighlightChanged(NSDraggingInfo)

Spring Loading

@protocol NSSpringLoadingDestination @required func springLoadingActivated(Bool, draggingInfo: NSDraggingInfo) func springLoadingHighlightChanged(NSDraggingInfo)

draggingInfo.springLoadingHighlight

NSSpringLoadingHighlight .None .Standard .Emphasized

Spring Loading

NSSpringLoadingDestination

Alignment Feedback

Tracking Loop

MouseUp?

move Item

nextEvent

Alignment Feedback

eventMaskfunc mouseDown()

setNeedsDisplay()

Tracking Loop

Alignment Feedback

MouseUp?

move Item

nextEvent

NSAlignmentFeedbackFilter

setNeedsDisplay()

Tracking Loop

Alignment Feedback

class func inputEventMask() -> NSEventMask

MouseUp?

move Item

nextEvent

setNeedsDisplay()

Tracking Loop

Alignment Feedback

MouseUp?

NSAlignmentFeedbackFiltermove Item

nextEvent

setNeedsDisplay()

Tracking Loop

Alignment Feedback

func updateWithEvent(NSEvent)

MouseUp?

nextEvent

setNeedsDisplay()

Tracking Loop

Alignment Feedback

MouseUp?

nextEvent

func updateWithPanRecognizer(NSPanGestureRecognizer)

setNeedsDisplay()

Tracking Loop

Alignment Feedback

MouseUp?

nextEvent

setNeedsDisplay()

Tracking Loop

Alignment Feedback

MouseUp?

setNeedsDisplay()

prepareAlignment

move Item

nextEvent

Tracking Loop

Alignment Feedback

MouseUp?

setNeedsDisplay()

prepareAlignment

move Item

nextEvent

Alignment FeedbackPreparing alignment

default

Alignment Feedback

Preparing alignment

aligned

func alignmentFeedbackTokenForHorizontalMovementInView(NSView?, previousX: CGFloat, alignedX: CGFloat, defaultX: CGFloat) -> NSAlignmentFeedbackToken?

Alignment Feedback

Preparing alignment

aligned

func alignmentFeedbackTokenForVerticalMovementInView(NSView?, previousY: CGFloat, alignedY: CGFloat, defaultY: CGFloat) -> NSAlignmentFeedbackToken?

Alignment Feedback

Preparing alignment

aligned

func alignmentFeedbackTokenForVerticalMovementInView(NSView?, previousY: CGFloat, alignedY: CGFloat, defaultY: CGFloat) -> NSAlignmentFeedbackToken?

Alignment Feedback

Preparing alignment

aligned

func alignmentFeedbackTokenForMovementInView(NSView?, previousPoint: NSPoint, alignedPoint: NSPoint, defaultPoint: NSPoint) -> NSAlignmentFeedbackToken?

Tracking Loop

MouseUp?

setNeedsDisplay()

Alignment Feedback

prepareAlignment

move Item

nextEvent

Tracking Loop

MouseUp?

setNeedsDisplay()

Alignment Feedback

[<Token>]

prepareAlignment

move Item

nextEvent

Tracking Loop

MouseUp?

setNeedsDisplay()

Alignment Feedback

performFeedback

[<Token>]

prepareAlignment

move Item

nextEvent

Tracking Loop

MouseUp?

setNeedsDisplay()

Alignment Feedback

performFeedback

[<Token>]

prepareAlignment

move Item

func performFeedback([<NSAlignmentFeedbackToken>], performanceTime: NSHapticFeedbackPerformanceTime)

nextEvent

Alignment FeedbackFeeling it

Consistent feel across appsEasy to integrate into tracking loopsDragging, resizing, etc…

Knight SummaryUnderstanding how the force flows

Force event streamSpring loading protocolAlignment Feedback

MasterControlling the force

Master Training ScheduleControlling the force

Trackpad configurationHaptics

Trackpad ConfigurationMore than just Force Click

NSPressureConfiguration

init(pressureBehavior: NSPressureBehavior)

.PrimaryDefault

.PrimaryClick

.PrimaryGeneric

.PrimaryAccelerator

.PrimaryDeepClick

.PrimaryDeepDrag

init(pressureBehavior: NSPressureBehavior) func set()

Set is not ideal• Only valid during a drag• Racing the user

Preferred approach: NSView - var pressureConfiguration: NSPressureConfiguration

• Configured before mouse down• Configured when app not responsive

HapticsThe Trackpad Strikes Back

Use sparinglySubtle interactions

NSHapticFeedbackManager class func defaultPerformer() -> <NSHapticFeedbackPerformer>

@protocol NSHapticFeedbackPerformer <NSObject> func performFeedbackPattern(NSHapticFeedbackPattern, performanceTime: NSHapticFeedbackPerformanceTime)

NSHapticFeedbackPattern .Generic .Alignment .LevelChange

NSHapticFeedbackPerformanceTime .Default .Now .DrawCompleted

Summary

Table Row ActionsAccelerator ButtonsSpring LoadingPressure Event StreamAlignment FeedbackConfiguration Haptic Feedback

More Information

DocumentationForceTouchCatalogAlignmentGuideshttp://developer.apple.com/library

Technical SupportApple Developer Forumshttp://developer.apple.com/forums

General InquiriesPaul MarcosApp Frameworks Evangelistpmarcos@apple.com

Related Sessions

What’s New in Web Development in WebKit and Safari Mission Tuesday 9:00AM

What’s New in Cocoa Presidio Tuesday 1:30PM

What’s New in NSCollection View Mission Thursday 4:30PM

Cocoa and Force Touch and Gestures Lab Frameworks Lab A Thursday 11:00AM

Cocoa and NSCollectionView Lab Frameworks Lab B Friday 9:00AM

Adopting New Trackpad Features - Apple...

Documents

Transcript of Adopting New Trackpad Features - Apple...

Make Model - Heritage Global Partners · Apple A1286 Apple A1286 Apple A1286 Apple A1286 Apple A1286 Apple A1286 Apple A1289 Apple A1289 Apple A1289 Apple A1297 Apple A1398 Apple

APPLE APPLE APPLE APPLE APPLE - wireless.att.com€¦ · APPLE APPLE APPLE APPLE APPLE AAL- Add A Line to the BT/SBS Plans ... DC- Data Connect $20+ DU- Data Unlimited UNLMsg- Unlimited

DTS DUAL CONSOLE REMOTE CONTROL WITH CAN TRACKPAD … · DTS DUAL CONSOLE REMOTE CONTROL WITH CAN TRACKPAD 90-889224 MAY 2006 Page 3 / 17 IMPORTANT: After cutting mounting area, make

iqs5xx-b000 trackpad datasheet - Azoteq

ENGLISH APPLE INC. APPLE TV (“APPLE TV”) …images.apple.com/legal/sla/docs/appletv.pdf · APPLE INC. APPLE TV (“APPLE TV”) SOFTWARE LICENSE AGREEMENT ... . 5. Services and

TM040040 Trackpad Specification - Squarespace · TM040040 --- Trackpad Specification-----Document Version: ... Table 1). Table 1. Pin Order of the J1 Connector for ... Due to the

Apple accessories store,cheap apple accessories,best apple accessories

No. SKU Description Price Accessories List.pdf51 MD827 Apple Ear Pods with Remote/Mic OMR 16.000 52 MB829 Apple Magic Mouse OMR 38.000 53 MC380 Apple Magic Trackpad OMR 39.000 ...

Trackpad Development Kit User Guide · 2018. 1. 16. · Trackpad Development Users Guide – Document Version v1.0 10 8. Next, select Tools > Serial Monitor. 9. This will open the

Your App and Next Generation Networks - Apple Inc.devstreaming.apple.com/videos/wwdc/2015/719ui2k57m/719/719_your... · © 2015 Apple Inc. All rights reserved. Redistribution or public

Apple to Apple

APPLE SNAIL RANGE APPLE APPLE SNAIL FACTS SHELLS …

Magic Trackpad - Boulanger€¦ · English 3 About the Indicator Light The indicator light displays the status of your Apple Magic Trackpad and the batteries. Â When you first turn

Improving Your App with Instruments - Apple Inc.devstreaming.apple.com/.../418/418_improving_your_app_with_instr… · Agenda What's new in Instruments Memory management Time profiling

Introducing the Contacts Framework - Apple Inc.devstreaming.apple.com/.../223_introducing_the_contacts_framework...Introducing the Contacts Framework For OS X, iOS, ... Picking Contacts

Conductive Inkjet Printed Passive 2D TrackPad for VR ...

What's New for Business CAEN · 2020-05-20 · Magic Keyboard (sold separately) features a floating design and trackpad for a whole new way to interact with iPad Pro. Trackpad support

Rechargeable Trackpad T651 for Mac - Logitech · Rechargeable Trackpad T651 for Mac Setup Guide ... A three-hour charge provides up to a month of battery power if you use the trackpad

232 Advanced User Interfaces DF - Apple Inc.devstreaming.apple.com/videos/wwdc/2014/232xxz8gxpbstio/232/232... · Refresh-ing Content No Content ... snapshot data source if collection