One way is with a LEFT JOIN, so that authors without books are included. Note that COUNT(b.BookId) will count only non-null BookId values for each author.
SELECT
a.AuthorName
, COUNT(b.BookId) AS countOfBooks
FROM #Authors AS a
LEFT JOIN #Books AS b ON b.AuthorId = a.AuthorId
GROUP BY a.AuthorName;