A major publishing deal for a debut crime novel has fallen through due to questions over the possible involvement of artificial intelligence (AI) in its writing.