Only if they can unlock your device. Passkeys require prior authentication to your passkey provider like username and password, your biometric (fingerprint/face) or your device's screen lock (PIN/pattern), etc to use. No one can use your passkey without physical access to your device and the ability to pass its configured security check(s).
