Showing posts with label Falsifiability. Show all posts
Showing posts with label Falsifiability. Show all posts

Friday, 11 September 2026

Research Journal Entry 6

 

Designing Our Ideas to Fail

September 11, 2026

There is a natural temptation when working on an idea you want to succeed.

You begin asking:

How can I make this work?

For Beyond the Light Barrier, that is probably the wrong question.

We are investigating possibilities involving faster-than-light communication, unconventional propulsion, spacetime geometry, wormholes, and other ideas at the boundaries of established physics.

These subjects already encourage imagination.

What they need from us is skepticism.

So the research process is adopting a deliberately uncomfortable rule:

Once we develop a promising model, we should try to make it fail.

Why Try to Break Our Own Models?

Suppose we develop a mathematical model that appears to produce an interesting result.

It would be easy to continue refining the model until we obtain the result we hoped to see.

But that creates a serious problem.

Are we learning something about nature?

Or are we simply learning how to make our model produce the answer we wanted?

The distinction is fundamental.

A scientific hypothesis becomes useful when it exposes itself to the possibility of being wrong.

That means asking questions that might destroy our favorite ideas.

What assumption is carrying the result?

What happens if that assumption changes?

Does the model conserve energy and momentum appropriately?

Does it conflict with relativity?

Does it require forms or distributions of stress-energy that are not known to be physically realizable?

Does quantum theory introduce additional restrictions?

Does the required energy become unreasonable when the system scales?

Is an apparent effect actually a numerical artifact?

Could ordinary physics produce the same measurement?

Would the result survive independent reproduction?

And perhaps most importantly:

What observation would make us abandon the hypothesis?

If we cannot answer that question, the hypothesis is not yet ready for serious testing.

The Gap Analyzer

This has led to an idea within the research process that I think of as the Gap Analyzer.

Instead of asking only what a model accomplishes, the Gap Analyzer asks what stands between the model and physical reality.

For any significant WD or WC model, we can identify several kinds of gaps.

There may be a theory gap.

The mathematics may depend upon physics that has not been established.

There may be an energy gap.

The required energy may exceed anything remotely achievable.

There may be a materials gap.

The model may require properties that no known material possesses.

There may be a measurement gap.

The predicted effect may be too small for available instruments to distinguish from noise.

There may be a control gap.

An effect might theoretically exist without any known way to create, modulate, stabilize, or stop it.

There may be a scaling gap.

Something that appears possible microscopically may become impossible when scaled to useful dimensions.

There may be a causality gap.

A proposed faster-than-light mechanism may introduce conflicts involving the ordering of cause and effect.

There may simply be an unknown gap—something we have not yet recognized.

The purpose of identifying these gaps is not to make the project sound more difficult.

It is to determine what question needs to be answered next.

Models Are Not Discoveries

This distinction deserves to be repeated throughout the project.

A model can be useful without being physically real.

A computer simulation can be valuable without demonstrating that nature behaves the same way.

A mathematical solution can be correct while describing conditions that cannot actually be engineered.

An analogy can help us understand a concept without reproducing the underlying physics.

For that reason, Beyond the Light Barrier will continue distinguishing among established evidence, accepted theory, published speculative theory, project hypotheses, engineering concepts, analytic calculations, numerical simulations, and physical experiments.

Those categories should not quietly blend together as the research progresses.

If we simulate a proposed spacetime geometry successfully, we should say:

The model produced this numerical result under these assumptions.

We should not say:

We demonstrated a warp drive.

Those statements mean very different things.

Negative Results Stay

Another rule follows naturally.

Failed models remain part of the research record.

Suppose WD-7 eventually fails because a fundamental constraint makes its proposed mechanism impossible.

We should not erase WD-7 and rename WD-8 as though the failed idea never existed.

Instead, the record should show:

What WD-7 proposed.

Why it initially appeared worth investigating.

What assumptions it used.

What analysis was performed.

What caused it to fail.

What we learned from the failure.

And whether any portion of the model remains useful.

The same principle applies to Project Communication.

If a WC experiment produces a carefully measured null result, that result belongs in the record.

A null result may eliminate one mechanism while helping us design the next experiment.

Retiring an Idea Is Progress

This changes the meaning of failure.

Suppose we begin with ten possible mechanisms.

Careful analysis eliminates eight.

It might appear that the research has mostly failed.

In reality, we have learned that eight paths probably do not lead where we hoped.

That is knowledge we did not have before.

The remaining two mechanisms can then receive greater scrutiny.

Perhaps both eventually fail as well.

That would be disappointing, but scientifically it would still tell us something about the boundaries imposed by nature.

Beyond the Light Barrier should therefore be willing to use words such as:

Rejected.

Unsupported.

Inconclusive.

Not reproducible.

Below detection threshold.

Requires revision.

Retired.

Those words are not embarrassing.

Used correctly, they demonstrate that the research process is working.

Artificial Intelligence Needs the Same Scrutiny

AI is an important tool in this project.

It can search and compare scientific literature, explain unfamiliar mathematics, derive and check equations, develop models, write software, perform numerical analysis, identify possible contradictions, and help us explore a much larger number of possibilities than I could reasonably investigate alone.

But AI introduces its own risks.

It can make mistakes.

It can misunderstand scientific literature.

It can generate plausible-looking mathematics that contains an error.

It can connect ideas in ways that sound convincing without sufficient evidence.

It can also become overly accommodating to the direction of a conversation.

For those reasons, an AI-generated result does not receive special authority within this project.

Important calculations should be independently checked.

Important claims should be traced to primary scientific sources whenever possible.

Numerical results should be reproducible.

Published claims should be distinguished from our interpretation of those claims.

And potentially significant results should eventually receive scrutiny from people with the appropriate scientific expertise.

AI can accelerate the research process.

It cannot eliminate the need for verification.

The Strongest Test Comes From the Other Side

As the models become more sophisticated, another practice should become increasingly important.

When we believe we have found a promising result, we should temporarily stop trying to improve it.

Instead, we should construct the strongest argument we can against it.

Assume the result is wrong.

Then ask why.

Search the literature for constraints we may have missed.

Check alternative mathematical formulations.

Change numerical resolution.

Test boundary conditions.

Examine conservation laws.

Look for hidden assumptions.

Try conventional explanations.

Estimate experimental uncertainty.

Ask whether another researcher could reproduce the result from the information we provide.

Only after surviving that process should our confidence increase.

When Something Becomes Worth Publishing

This also helps establish when Beyond the Light Barrier research should move beyond the Research Journal.

A journal entry can document an idea while it is still developing.

A Research Explained paper can communicate a sufficiently mature concept to readers without requiring them to follow advanced mathematics.

A Technical Paper requires considerably more.

Before calling something a Technical Paper candidate, we should expect a clearly defined question, relevant scientific literature, explicit assumptions, mathematical formulation, reproducible methods, quantitative results, uncertainty and limitations, alternative explanations, and criteria capable of proving the hypothesis wrong.

Not every model will reach that point.

Most probably should not.

The Standard Going Forward

The objective of Beyond the Light Barrier is ambitious.

But ambitious questions require stricter standards, not weaker ones.

So when a future WD or WC model appears particularly exciting, the next response should not be:

We found it.

The next response should be:

Now let's try to break it.

If it breaks, we document why.

If it survives, we test it harder.

If it continues surviving, we invite others to find the weakness we missed.

And if, someday, a result survives the mathematics, the literature, reproduction, experimental controls, independent examination, and repeated attempts to falsify it—

then we may finally have something genuinely interesting to report.

Until then, the failures are part of the journey too.

Research Journal Entry 4

 

Start Small: Making the Communication Question Testable

September 11, 2026

Once Project Communication became a separate research path within Beyond the Light Barrier, another problem became apparent.

The question was still much too large.

Asking whether humans could someday communicate faster than light across interstellar distances may be interesting, but it does not immediately give us an experiment we can perform.

We needed to make the question smaller.

Much smaller.

From Light-Years to the Laboratory

The original motivation for Project Communication involves enormous distances.

If future spacecraft could someday travel effectively faster than light, conventional communication delays could become a significant limitation. Ultimately, we would want communication capable of operating across astronomical distances.

But that is an objective, not a starting experiment.

Suppose some physical mechanism really could transmit information in a way that differs from ordinary electromagnetic propagation.

The first question should not be whether it works across ten light-years.

It should be:

Can we detect the effect across ten centimeters?

Perhaps the appropriate distance would actually be one centimeter, one meter, or ten meters. The precise number depends upon the physical mechanism being tested and the measurement resolution available.

The principle is what matters:

Find the smallest scale at which the hypothesis makes a measurable prediction.

Why Smaller Is Better

Small experiments provide several advantages.

Distances can be measured accurately.

Timing can be controlled more precisely.

Environmental conditions can be monitored.

Equipment can be physically isolated.

Experiments can be repeated many times.

Potential sources of interference can be investigated.

And, perhaps most importantly, other researchers could reproduce the experiment without requiring spacecraft or enormous budgets.

If a proposed effect cannot survive controlled laboratory testing, there is little reason to design an interplanetary version of the same experiment.

What Are We Actually Looking For?

This question requires considerable care.

Project Communication is not simply looking for something unusual.

An unexpected measurement is not automatically evidence of new physics.

Laboratories encounter unexpected results all the time because of equipment behavior, electromagnetic interference, thermal effects, timing errors, software bugs, statistical fluctuations, calibration problems, environmental coupling, or assumptions that turned out to be wrong.

Therefore, an experiment needs to begin with a prediction.

A simplified example might look like this:

A transmitter encodes a randomly generated sequence of bits.

A conventional communication channel is prevented from carrying that sequence to a physically separated receiver during the measurement interval.

The proposed mechanism predicts that information should nevertheless become detectable at the receiver.

The receiver records its result independently.

Only afterward are the transmitted and received records compared.

If the receiver cannot recover information beyond what chance and known physical coupling predict, the experiment has not demonstrated communication.

If an apparent correlation occurs, the appropriate response is not immediately:

We discovered faster-than-light communication.

The appropriate response is:

What conventional explanation did we miss?

Information Is the Critical Test

This distinction is particularly important when considering quantum phenomena.

Two systems can display correlations without providing a controllable communication channel.

For Project Communication, correlation alone is insufficient.

The sender must be able to choose or encode information, and the receiver must be able to recover that information in a manner that cannot be explained by a conventional signal path or prior shared information.

That gives us a much stronger experimental target:

controlled information transfer rather than unexplained correlation.

Timing Matters

Eventually, a claim of faster-than-light communication would require more than demonstrating an unusual information channel.

We would also need to determine how quickly information traveled.

At very short distances, that creates a serious measurement problem.

Light crosses one meter in only a few nanoseconds.

If an experimental system introduces microseconds or milliseconds of electronic processing delay, simply comparing the time at which two computers report events would tell us very little about the propagation mechanism itself.

This means the first experiment does not necessarily need to prove faster-than-light propagation.

There may be two separate questions:

First: Does an unconventional communication channel exist at all?

Second: If it exists, what is its propagation behavior?

Separating those questions may make the research considerably more manageable.

Distance Becomes an Experimental Variable

If an effect were ever reproducibly demonstrated, distance itself could become part of the experiment.

For example:

1 centimeter.

10 centimeters.

1 meter.

10 meters.

100 meters.

Greater distances only when justified by previous results.

The important measurement would not merely be whether the effect continues to exist.

We would examine how it changes with distance.

Does signal strength decline?

Does error rate increase?

Does propagation time increase?

Does the effect disappear beyond some distance?

Does it behave exactly as a conventional physical interaction should?

Each outcome provides information.

Null Results Matter

Suppose we construct an experiment around a particular Project Communication hypothesis and detect nothing.

That does not necessarily mean the experiment failed.

If the apparatus was capable of detecting the effect predicted by the model, then the absence of that effect constrains the model.

The result might tell us:

This mechanism does not operate under these conditions at or above this sensitivity.

That becomes part of the permanent research record.

The model may need modification.

It may need a different experiment.

Or it may need to be retired.

The important point is that we should not continually change a hypothesis merely to prevent it from being falsified.

The Experimental Ladder

A useful picture is beginning to emerge for Project Communication.

Rather than one enormous experiment, the project can be thought of as an experimental ladder.

Stage 1 — Mathematical viability

Does the proposed mechanism survive basic theoretical analysis?

Stage 2 — Detectability

Does the model predict something that available instruments could actually measure?

Stage 3 — Laboratory experiment

Can the predicted effect be produced under controlled conditions?

Stage 4 — Independent reproduction

Can another experiment reproduce the result?

Stage 5 — Conventional-explanation challenge

Can known signal paths, environmental coupling, equipment behavior, statistics, or ordinary physics explain the result?

Stage 6 — Distance scaling

Does the effect behave predictably as separation increases?

Stage 7 — Propagation measurement

Can its speed or other propagation properties be measured?

Only after surviving those stages would increasingly large terrestrial or space-based experiments make sense.

Engineering Must Wait for Physics

As an engineer, I naturally find myself thinking ahead.

How would the transmitter work?

How would the receiver work?

How would the devices synchronize?

How much energy would they require?

How could one eventually operate aboard a spacecraft?

Those are useful questions because they can expose weaknesses in an idea.

But there is also a danger.

It is possible to design an elaborate engineering system around a physical effect that has never been demonstrated.

For now, Project Communication needs to keep a clear distinction between two activities:

Physics asks whether the effect exists.

Engineering asks how to use it if it does.

We can think about both, but we must not confuse an engineering concept with evidence that the underlying physics works.

A Different Kind of Progress

This approach changes what progress means for Beyond the Light Barrier.

Progress does not necessarily mean getting closer to building an interstellar communication device.

Progress may mean eliminating a mechanism that does not work.

It may mean discovering that a predicted effect is far below measurable levels.

It may mean identifying an assumption that contradicts established physics.

It may mean reducing a complicated question to one experiment capable of giving us a meaningful answer.

That is still progress.

Where Project Communication Goes Next

The next challenge is therefore not to design the final communication system.

It is to continue narrowing the candidate mechanisms until we can identify one with:

a clearly stated physical hypothesis,

a quantitative prediction,

a measurable effect,

a practical experimental configuration,

appropriate controls,

and a result capable of falsifying the hypothesis.

When Project Communication reaches that point, something important will have happened.

We will have moved from asking whether extraordinary communication might someday be possible to asking nature a specific question that an experiment can answer.

That is the direction the research now needs to take.

Research Journal Entry 6

  Designing Our Ideas to Fail September 11, 2026 There is a natural temptation when working on an idea you want to succeed. You begin asking...