You can't do it in one line, but here's a quick hack to save having to maintain the create table code, which can come in handy if the table you're deleting from is wide.
DROP TABLE IF EXISTS #TEST_INPUT
DROP TABLE IF EXISTS #TEST_OUTPUT
CREATE TABLE #TEST_INPUT (ID INT PRIMARY KEY IDENTITY, VAL INT)
INSERT INTO #TEST_INPUT (VAL) VALUES (1),(2),(3)
Create empty output table
This makes an empty copy of the 'input' table with the
JOIN removing the identity.
SELECT A.* INTO #TEST_OUTPUT FROM #TEST_INPUT A JOIN #TEST_INPUT B ON 1=0
Now delete into the output table
DELETE FROM #TEST_INPUT OUTPUT DELETED.* INTO #TEST_OUTPUT
(add a where clause to suit)
Yes, it's a bit of a hack - comments appreciated.