A Stationary First-Order Method with a Simplex Cycle
Abstract
We construct a stationary linear first-order method with rational coefficients that has a five-cycle on a -strongly convex function with -Lipschitz gradient, yet has no two-dimensional roots-of-unity cycle of any period on that function class. The cycling objective is an explicit quadratic plus squared distance to a polytope. Its five orbit points form a four-dimensional simplex. A necessary interpolation inequality for any polygonal orbit reduces nonexistence to a scalar trigonometric condition, which we exclude by elementary rational interval bounds. The result gives a counterexample to the general stationary-method cycle-reduction conjecture proposed by Goujaud, Taylor, and Dieuleveut in 2023, as written without a quadratic-convergence restriction.
1. Introduction
Can all cyclic behavior of a stationary first-order optimization method be detected on a two-dimensional regular polygon? This paper gives a negative answer for the unrestricted class of stationary methods. The example has rational coefficients, uses six stored iterates and one stored gradient, and cycles on the vertices of a four-dimensional simplex. Nevertheless, on the same smooth strongly convex function class, it cannot follow a roots-of-unity cycle of any length, even with a nontrivial jump order around the polygon.
The documented conjecture.
Goujaud, Taylor, and Dieuleveut proposed a general reduction from cyclic trajectories of stationary first-order methods to two-dimensional roots-of-unity trajectories in the concluding section of their 2023 preprint [1]. The corresponding statement is numbered Conjecture 7.1 in its 2025 revision [2]. Their conjecture specifies a particular family of interpolating functions. We rule out the required polygonal trajectory on every function in the relevant class, so the distinction between that special family and the full class does not affect our obstruction.
Here, “stationary first-order method” means a fixed rule using finitely many previous iterates and their first-order oracle outputs; arbitrary initial histories are allowed. This is the definition given by Goujaud et al. [3, Definition 2.1]. Our rule is linear, uses scalar coefficients independent of the ambient dimension, and preserves translations because its iterate coefficients sum to one.
Scope of the resolution.
The target is the conjecture quantified over all stationary first-order methods. The constructed method is deliberately artificial and is not a recommended optimization algorithm. In fact, we prove that it is not convergent on all strongly convex quadratics. Thus the result does not refute a version restricted to methods that converge on all quadratics, nor the separate conjecture specifically about heavy-ball. It also does not exclude arbitrary planar cycles: it excludes the roots-of-unity shape specified in the target conjecture.
Research status.
This is a candidate counterexample manuscript with a complete, self-contained mathematical argument. A targeted literature check on September 29, 2026 did not locate an earlier resolution of the general stationary-method conjecture. That search is not an exhaustive priority certification. The manuscript has not undergone independent specialist or peer review. Its finite arithmetic checks are exact; they are supplementary to, rather than a replacement for, the proof below.
1.1 Main statement
Let denote the continuously differentiable functions on a finite-dimensional Euclidean space that are -strongly convex and have -Lipschitz gradient. Define the following stationary method, with six initial points :
The delayed gradient can be evaluated at the indicated stored point or retained from an earlier oracle call. No second-order information is used.
Definition 1.1 (Roots-of-unity trajectory). A nonconstant roots-of-unity trajectory is a sequence
where , , , , and are orthonormal. The center , radius, plane, orientation, and starting phase are arbitrary. A phase can be absorbed into . We also include , defined directly as for a unit vector ; this allows the two-point case even in dimension one. A noncoprime jump reduces to this definition after replacing by the actual period.
Theorem 1.2 (A simplex cycle without any roots-of-unity cycle). Method (1) has both of the following properties.
(i) There is an explicitly specified and an initial history for which the method is exactly periodic with minimal period five. The five points span a four-dimensional affine subspace. Restriction to that subspace gives the same example in a four-dimensional Euclidean space.
(ii) For every finite-dimensional Euclidean space , every , and every , no roots-of-unity trajectory in Definition 1.1 satisfies (1).
The proof separates the existence of the simplex cycle from the exclusion of all polygonal cycles. The latter is an all-period analytic argument, not a search over a finite range of periods.
2. Two elementary facts about smooth convex functions
We write for the Euclidean inner product and . Strong convexity with parameter one means
2.1 Projection and a concrete function class
Lemma 2.1 (Squared distance to a compact convex set). Let be a nonempty compact convex subset of a Euclidean space. Each has a unique closest point in , characterized by
The function is convex and continuously differentiable, with
The residual map is -Lipschitz. Consequently
belongs to .
Proof. Compactness gives existence of a minimizer of . If two distinct points both minimized it, their midpoint would be in , and
would be strictly smaller. This proves uniqueness.
For necessity of (4), fix and minimize along for . Its squared distance to has nonnegative right derivative at , namely . Conversely, if the displayed inner product is nonpositive for every , then
so .
Apply the criterion to with , and to with . Adding the resulting inequalities gives
In particular is -Lipschitz by Cauchy–Schwarz. If , then
For differentiability, using as a candidate at gives
Using as a candidate at gives the reverse estimate
where the last step uses the Lipschitz bound for . These inequalities prove (5). Continuity of that gradient also follows from the Lipschitz bound.
For , the point is feasible in . Convexity of the squared norm therefore yields
Thus is convex. Adding makes -strongly convex. Finally
This establishes all assertions. ◻
2.2 A necessary interpolation inequality
The following standard type of inequality underlies smooth strongly convex interpolation [4]. We include its proof to make the exclusion argument self-contained.
Lemma 2.2. For every and every , putting and gives
Proof. Integration of the gradient along a segment and the -Lipschitz bound give
Define . Strong convexity implies convexity of , and the preceding upper bound becomes
Fix and let . This is convex and satisfies , so for all . At , choose in the upper bound. It follows that
Equivalently,
Substitute and . The quadratic terms on the left simplify to , giving (8). ◻
3. The explicit simplex cycle
Let be the standard basis of and let . All subscripts in this section are read modulo five. Set
Define the compact convex polytope and objective
These formulas specify the function everywhere, without an unspecified extension or numerical interpolation problem. By Lemma 2.1, .
3.1 Verification of the prescribed gradients
Lemma 3.1. For each , and .
Proof. We verify the projection criterion at every vertex of . Let be the orthogonal coordinate permutation with . Then , , and . Thus it suffices to verify for all .
The vectors, with a common denominator where useful, are
For completeness, the numerator vectors of are
For example, the first nonzero inner product has numerator . The other three numerator sums are, respectively,
Each is nonpositive. Every is a convex combination of the , so the inequality also holds for by linearity. Lemma 2.1 gives , and permutation symmetry gives the result for all .
Using the gradient formula from that lemma,
as claimed. ◻
3.2 Exact periodicity and the minimizer
Initialize (1) with for . Suppose the previous six iterates have this form. In the following calculation all subscripts are modulo five, and Lemma 3.1 supplies the gradient:
The third equality uses and . The last uses . Induction proves the infinite periodic trajectory. The are distinct, hence its minimal period is five.
The four differences , , are linearly independent. Thus the affine span is
which has dimension four. All belong to . Restricting to preserves strong convexity and the gradient Lipschitz bound, and its intrinsic gradients at the cycle points remain . An orthonormal identification of with therefore gives a four-dimensional example.
Furthermore, , so . Hence and , making zero the unique minimizer. At every cycle point,
Consequently,
The cycle is a genuine failure to approach the minimizer. This proves part (i) of Theorem 1.2.
4. A necessary condition for a polygonal cycle
For any sequence satisfying the method, write . Rearranging (1) with its time index shifted by two gives
Initially this identity holds for . If a sequence is periodic and satisfies the recurrence from its prescribed starting history onward, each residue class modulo its period occurs for arbitrarily large . The identity thus holds at every point of that periodic orbit.
Suppose now that a roots-of-unity trajectory in Definition 1.1 satisfies the method. The coefficients on the right side of (12) sum to zero, so the center cancels. For , identify the plane with by sending to and to . For , take , , and identify with the real axis; the formulas below apply with . After dividing vectors by , put . The prescribed gradient is then , where
In particular, the recurrence forces the gradient to lie in the plane; there is no unaccounted orthogonal component.
Lemma 4.1 (Polygon obstruction). If a roots-of-unity trajectory with period and jump angle satisfies the method on some , then
For , the cotangent is zero.
Proof. Fix an integer shift , and apply Lemma 2.2 to and . Let , , and . Rotation invariance of inner products gives
Substitution into the interpolation inequality gives
because
Sum over . The function values cancel by periodicity. Since ,
This argument does not assume that the function values on the orbit are equal.
Since is coprime to , there are shifts giving and modulo . Take the stronger of the two inequalities (17). For , divide by and use
This gives (16). For , take directly in (17); its sine is zero and its cosine is , yielding . ◻
5. Excluding every period
Write and . The triple-angle and double-angle identities turn (14) into the polynomial
Lemma 5.1 (Uniform scalar barrier). For every , with as in (18),
Proof. Twice the left side equals
We give rational bounds on intervals covering .
First, is strictly negative on both and : indeed, on either interval
Direct evaluation gives
If , monotonicity gives . Hence , proving (19) on this interval. If , monotonicity instead gives , which gives the same conclusion.
For , we have , hence . Dropping the nonnegative square in (20), and using that its remaining terms increase with , yields
For , monotonicity gives , so . Also , hence . Therefore
Finally, for , we have , giving . Also , hence . Thus
The five intervals cover the entire domain, completing the proof. ◻
Proof of Theorem 1.2, part (ii). For , monotonicity of cotangent on gives
For an exact verification of the last inequality, set and . The geometric sum gives, upon taking real parts,
Thus , and positivity selects . The half-angle identity then gives
the strict comparison follows from , whose square is . It now follows from Lemma 5.1 that
contradicting the necessary condition (16).
It remains to check . For , , , and , giving
For , either coprime jump has and . Thus , and , contradicting (16). For , the coprime jumps have , , and . Consequently
Every possible period is excluded. Together with the construction, this proves Theorem 1.2. ◻
6. What the example establishes, and what it does not
The same fixed, dimension-independent recurrence has a cyclic trajectory in and has no roots-of-unity trajectory in that class. Its six iterate coefficients sum to
It is therefore a stationary first-order rule in the stated sense, with the usual translation consistency of scalar linear methods. The existence and exclusion claims use the same smoothness and strong convexity parameters. This disproves the general implication in the documented conjecture as written.
The example also identifies a limitation of trying to replace a cycle by one of its individual Fourier components. The simplex has two nontrivial real Fourier planes. Their combined interpolation constraints can hold even when neither isolated circular component is admissible. Symmetry of a feasible cycle therefore need not provide a feasible single-frequency cycle. This is an interpretation of the construction, not an additional premise in the proof.
6.1 Quadratic instability is a genuine limitation
Proposition 6.1. For every , method (1) applied to in one dimension has an initialization that does not converge to the minimizer.
Proof. The scalar recurrence has characteristic polynomial
For , rearrangement of this polynomial is exactly the filter identity (12); since ,
But , so a real value requires or modulo . At these two angles, and , neither of which belongs to . Thus has no root on the unit circle.
The polynomial is monic of degree six and has constant term one. The product of its six roots is one, and hence the product of their moduli is one. They cannot all have modulus less than one. Since none has modulus one, at least one root has . The complex sequence satisfies the recurrence. Its real and imaginary parts are real solutions; at least one of them is unbounded, because otherwise would remain bounded. Initialize with the first six terms of that real solution. The resulting iterates do not converge to zero. ◻
Accordingly, the theorem makes no claim about the conjecture after imposing convergence on every quadratic in the class. Nor does it settle the heavy-ball-specific reduction, which restricts the recurrence to two stored iterates and a current gradient. These distinctions are essential to the interpretation of the result.
7. Conclusion
A six-memory stationary first-order rule can cycle on a smooth strongly convex objective while admitting no two-dimensional roots-of-unity cycle of any period in the same function class. The objective is an explicit quadratic plus a squared distance to a polytope, the cycle data and method coefficients are rational, and the exclusion proof uses an elementary uniform scalar inequality. The resulting counterexample addresses the unrestricted general stationary-method conjecture. Determining whether an analogous reduction holds under additional algorithmic stability assumptions is a separate question.
Disclosure of AI Assistance
This work was prepared with extensive assistance from GPT-6 Astra Ultra. The model assisted with literature search and synthesis, evidence extraction and organization, mathematical formulation and proof drafting, manuscript drafting and revision, and LaTeX, tables, figures, and reproducibility scripts. AI-assisted checking and separate agent reviews were also used; these do not constitute independent human peer review or replace expert verification of sources, mathematics, and interpretations. The reported survey statistics are derived from published sources. Responsibility for the final content, claims, citations, and any errors remains with the human authors.
References
- B. Goujaud, A. Taylor, and A. Dieuleveut. Provable non-accelerations of the heavy-ball method. 2023. arXiv:2307.11291v1, July 21, 2023. https://arxiv.org/abs/2307.11291v1.
- B. Goujaud, A. Taylor, and A. Dieuleveut. Provable non-accelerations of the heavy-ball method. 2025. arXiv:2307.11291v2, October 9, 2025. Conjecture 7.1. https://arxiv.org/abs/2307.11291v2.
- B. Goujaud, A. Dieuleveut, and A. Taylor. Counter-examples in first-order optimization: A constructive approach. 2023. arXiv:2303.10503, revised January 10, 2025. Definition 2.1. https://arxiv.org/abs/2303.10503.
- A. B. Taylor, J. M. Hendrickx, and F. Glineur. Smooth strongly convex interpolation and exact worst-case performance of first-order methods. Mathematical Programming, 161, pp. 307–345, 2017. https://doi.org/10.1007/s10107-016-1009-3.
Appendix A. Exact arithmetic and reproducibility
The accompanying verify.py uses only Python’s standard library and rational arithmetic. It checks every projection inequality, every interpolation inequality for the five points, the recurrence on each residue class, the sum of the method coefficients, the value at each cycle point, and the rational constants in the interval proof. An explicit failure raises an exception even when Python assertions are disabled. No floating-point tolerance is used.
For an additional check independent of the projection table, define
All cycle function values equal , so Lemma 2.2 requires . With and , the exact quantities are
| 1 | |||
| 2 | |||
| 3 | |||
| 4 |
In each row , so the fourth column is obtained by negating the sum of the second column, one, and one quarter of the third column. Cyclic coordinate permutation supplies all ordered pairs. Strict positivity of every off-diagonal slack also shows that existence of the cycle is not based on a zero-margin numerical interpolation test.
The code checks finite arithmetic only. The proof that all periods are excluded is the interval argument in Lemma 5.1 together with the necessary condition in Lemma 4.1; finite tests of selected periods would not establish that claim.
Citation
Please cite this work as:
Zhao, Jinze. “A Stationary First-Order Method with a Simplex Cycle”. jimz7-blog.pages.dev (Sep 2026).
https://jimz7-blog.pages.dev/stationary-first-order-method-with-a-simplex-cycle/
Or use the BibTeX citation:
@article{zhao2026stationary-first-order-method-with-a-simplex-cycle,
title = {{A Stationary First-Order Method with a Simplex Cycle}},
author = {Zhao, Jinze},
journal = {jimz7-blog.pages.dev},
year = {2026},
month = {September},
url = {https://jimz7-blog.pages.dev/stationary-first-order-method-with-a-simplex-cycle/}
}