So why do we still use this architecture in the majority of modern
computing?
The assumption itself, first clause: Modern Computer <= Von Neumann
Firstly, do note that the Von Neumann architecture is not used exclusively: almost any current "Von Neumann" machine except for very small microcontrollers (which are occasionally Harvard machines) features several important extensions to the original architecture, from DMA to MMUs.
Specialized coprocessors are very popular - most notably, GPUs.
Those work very well in conjunction to a Von Neumann machine.
The assumption itself, second clause: Von Neumann <= Modern Computers
The limitations of the Von Neumann architecture and the need for non-Von Neumann architectures for certain applications is well recognized in the scientific community, most importantly whenever "[general] artificial intelligence" of interest, see for example this very recent paper, which continues the line of work started by Carver Mead, who envisioned one of the most radical departures from "classical" architectures in 1989, in the form of analog, time-continuous, highly parallel "neuromorphic" chips.
Your premise is thus, in a way, flawed, unless it is implied that you're referring purely to industrial applications (read on for that part).
On the notion of efficiency
Note that Mead himself had envisioned his architecture as complementary to a traditional Von Neumann machine.
Why?
This brings us to another important point: you mention "more efficient architectures", but efficient for which sort of workload?
Sontag and Siegelmann have famously proved that a feed forward neural network is Turing-complete, as is, of course, the Von Neumann architecture, and if we accept Church's thesis (which has never been seriously challenged in quite a while) that this amounts to the ability to compute all computable functions, they're theoretically interchangeable and unsurpassed in their abilities.
However, leaving aside for a moment the issue of practicality, they are not as efficient for the same applications.
I'm guessing that a neuromorphic chip such as Carver Mead's would make for a terrible Excel machine.
So why mostly Von Neumann in industrial applications?
But yes: even if research has branched in other directions and has gotten to the status of prototypes and early industrial devices Von Neumann architectures are still the bread and butter of industrial applications (and a good foundation to extend with coprocessors and specialized optimizations).
It's safe to assume that the reason is practical:
- They're universal -- i.e. "good enough" in the broadest possible sense: they are Turing complete and sufficiently close to some theoretical models such as the TM itself or the URM; it is safe to assume that the ubiquity of the Von Neumann machine has influenced developement of theory as well.
- They're tolerably easy to reason about and very well understood by engineers and developers
- They work very well for existing industrial workloads that drive the demand for hardware R&D; there is 60 years' worth of algorithms and software for Von Neumann machines.
Von Neumann closed under copper cable?
Finally - and only partly tongue-in-cheek: do note that it is very easy to obtain a decidedly non-Von Neumann machine from off-the-shelf parts: just buy two laptops and connect them with an UTP cable and you have a very strange machine where you don't have uniform, synchronized access to a single mutable storage or a single clock.