Selberg sieve variational problem

(Difference between revisions)
 Revision as of 02:12, 18 December 2013 (view source) (→Lower bounds)← Older edit Revision as of 04:16, 18 December 2013 (view source) (→Lower bounds)Newer edit → Line 34: Line 34: == Lower bounds == == Lower bounds == - We will need some parameters $c, T, \tau > 0$ to be chosen later (in practice we take c close to $1/\log k$, T a small absolute constant, and $\tau$ a small multiple of c). + We will need some parameters $c, T, \tau > 0$ to be chosen later (in practice we take c close to $1/\log k$, T a small multiple of c, and $\tau$ a small multiple of c/k). For any symmetric function F on the simplex ${\mathcal R}_k$, one has For any symmetric function F on the simplex ${\mathcal R}_k$, one has Line 130: Line 130: If we have the pointwise bound If we have the pointwise bound - :$r \log_+ \frac{r-s}{T} + (r-s)_+ \frac{s}{kT} \leq C (s - s_0)^2$ (*) + :$r \log_+ \frac{r-s}{T} + (r-s)_+ \frac{s}{kT} \leq C (s - s_0)^2 + C'$ (*) - for some $C, s_0 > 0$ and all s, then we have + for some $C, C', s_0 > 0$ and all s, then we have :$Z_1 + Z_2 \leq C {\mathbf E} (S_k - s_0)^2$ :$Z_1 + Z_2 \leq C {\mathbf E} (S_k - s_0)^2$ - :$= C ( (k \mu - s_0)^2 + k \sigma^2 )$ + :$= C ( (k \mu - s_0)^2 + k \sigma^2 ) + C'$ where where Line 164: Line 164: :$Y_2 \leq \frac{k}{k-1} Z_4$ :$Y_2 \leq \frac{k}{k-1} Z_4$ - where + where $Z_4 = Z_4[r]$ is the quantity - :$Z_4 := \frac{\log k}{m_2} {\mathbf E} (r - S_{k-1} - c)^2 \int_{[0,\min(r-S_{k-1},T)]} g(s)^2 h(s)\ ds.$ + :$Z_4 := \frac{\log k}{m_2} {\mathbf E} (r - S_{k-1} - c)^2 \int_{[0,\min(r-S_{k-1},T)]} g(s)^2 h_r(s)\ ds.$ Putting all this together, we have Putting all this together, we have - :$r \Delta_k {\mathbf P} ( S_k \leq r ) \leq \frac{k}{k-1} ( C ( (k \mu - s_0)^2 + k \sigma^2 ) + Z_3 + Z_4 ).$ + :$r \Delta_k {\mathbf P} ( S_k \leq r ) \leq \frac{k}{k-1} ( C ( (k \mu - s_0)^2 + k \sigma^2 ) + C' + Z_3 + Z_4[r] ).$ + + At this point we encounter a technical problem that $Z_4$ diverges logarithmically (up to a cap of $\log k$) as $S_{k-1}$ approaches r.  To deal with this issue we average in r, and specifically over the interval $[1,1+\tau]$.  We assume that the pointwise bound (*) is valid for all r in this interval. If we have + + :$\int_0^1 (1+a\tau) 1_{x > 1+a\tau}\ da \leq \delta (x-k\mu)^2$ + + for all x and some $\delta > 0$, then + + :$\int_0^1 (1+a\tau) {\mathbf P} ( S_k \leq 1+a\tau )\ da \leq 1 + \frac{\tau}{2} - k \delta \sigma^2$ + + and hence + + :$\Delta_k (1 + \frac{a\tau}{2} - k \delta \sigma^2) \leq \frac{k}{k-1} ( C ( (k \mu - s_0)^2 + k \sigma^2 ) + C' + Z_3 + \int_0^1 Z_4[1+a\tau]\ da ).$ + + If $\tau \leq c$, we may bound + + :$\int_0^1 Z_4[1+a\tau]\ da := \frac{\log k}{m_2} {\mathbf E} ((1 - S_{k-1})^2 + c^2) \int_{[0,T)]} g(s)^2 (\int_0^1 h_{1+a\tau}(s) 1_{1+a\tau-S_{k-1} \geq s}\ da)\ ds.$ + + Observe that + + :$\int_0^1 h_{1+a\tau}(s) 1_{1+a\tau-S_{k-1} \geq s}\ da = \int_0^1 \frac{da}{1-S_{k-1}+a\tau+(k-1)s} 1_{1-S_{k-1}+a\tau \geq s}$ + :$= \frac{1}{\tau} \int_{[\max(ks, 1-S_{k-1}+(k-1)s), 1-S_{k-1}+\tau+(k-1)s]} \frac{du}{u}$ + :$\leq \frac{1}{\tau} \log \frac{ks+\tau}{ks}$ + + and so + :$\int_0^1 Z_4[1+a\tau]\ da \leq W \frac{\log k}{\tau} {\mathbf E} ((1 - S_{k-1})^2 + c^2)$ + + :$= W \frac{\log k}{\tau} ((1 - (k-1)\mu)^2 + (k-1) \sigma^2 + c^2)$ + + where + + :$W := m_2^{-1} \frac{1}{\tau} \int_{[0,T)]} g(s)^2 \log(1+\frac{\tau}{ks})\ ds.$ + + We thus arrive at the final bound + + :$\Delta_k \leq \frac{k}{k-1} \frac{ C ( (k \mu - s_0)^2 + k \sigma^2 ) + C' + Z_3 + W \frac{\log k}{\tau} ((1 - (k-1)\mu)^2 + (k-1) \sigma^2 + c^2)}{1 + \frac{\tau}{2} - k \delta \sigma^2}$ + + provided that the denominator is positive. + + If we set $c = \tau := 1/\log k$, with $T$ a small multiple of c, then $\mu \approx \frac{1}{k}(1 - \frac{A}{\log k})$ for a large absolute constant A, and $\sigma^2$ is a small multiple of $\frac{1}{k \log^2 k}$.  This makes the denominator comparable to 1; if we then set $s_0 = k \mu$, then one can check that (*) holds with $C = O(\log^2 k )$ and $C' = O(1)$; also, $Z_3, W = O(1)$, finally giving the bound + + :$\Delta_k = O(1)$ - At this point we encounter a technical problem that $Z_4$ diverges logarithmically as $S_{k-1}$ approaches r.  To deal with this issue we average in r, and specifically over the interval $[1,1+\tau]$.  We assume that the pointwise bound (*) is valid for all r in this interval + and thus we have the lower bound - ... + :$M_k \geq\frac{k}{k-1} \log k - O(1) = \log k - O(1)$. == More general variational problems == == More general variational problems ==

Revision as of 04:16, 18 December 2013

Let Mk be the quantity

$\displaystyle M_k := \sup_F \frac{\sum_{m=1}^k J_k^{(m)}(F)}{I_k(F)}$

where F ranges over square-integrable functions on the simplex

$\displaystyle {\mathcal R}_k := \{ (t_1,\ldots,t_k) \in [0,+\infty)^k: t_1+\ldots+t_k \leq 1 \}$

with $I_k, J_k^{(m)}$ being the quadratic forms

$\displaystyle I_k(F) := \int_{{\mathcal R}_k} F(t_1,\ldots,t_k)^2\ dt_1 \ldots dt_k$

and

$\displaystyle J_k^{(m)}(F) := \int_{{\mathcal R}_{k-1}} (\int_0^{1-\sum_{i \neq m} t_i} F(t_1,\ldots,t_k)\ dt_m)^2 dt_1 \ldots dt_{m-1} dt_{m+1} \ldots dt_k.$

It is known that DHL[k,m + 1] holds whenever EH[θ] holds and $M_k > \frac{2m}{\theta}$. Thus for instance, Mk > 2 implies DHL[k,2] on the Elliott-Halberstam conjecture, and Mk > 4 implies DHL[k,2] unconditionally.

Upper bounds

We have the upper bound

$\displaystyle M_k \leq \frac{k}{k-1} \log k$ (1)

that is proven as follows.

The key estimate is

$\displaystyle \int_0^{1-t_2-\ldots-t_k} F(t_1,\ldots,t_k)\ dt_1)^2 \leq \frac{\log k}{k-1} \int_0^{1-t_2-\ldots-t_k} F(t_1,\ldots,t_k)^2 (1 - t_1-\ldots-t_k+ kt_1)\ dt_1.$. (2)

Assuming this estimate, we may integrate in $t_2,\ldots,t_k$ to conclude that

$\displaystyle J_k^{(1)}(F) \leq \frac{\log k}{k-1} \int F^2 (1-t_1-\ldots-t_k+kt_1)\ dt_1 \ldots dt_k$

which symmetrises to

$\sum_{m=1}^k J_k^{(m)}(F) \leq k \frac{\log k}{k-1} \int F^2\ dt_1 \ldots dt_k$

giving the desired upper bound (1).

It remains to prove (2). By Cauchy-Schwarz, it suffices to show that

$\displaystyle \int_0^{1-t_2-\ldots-t_k} \frac{dt_1}{1 - t_1-\ldots-t_k+ kt_1} \leq \frac{\log k}{k-1}.$

But writing $s = t_2+\ldots+t_k$, the left-hand side evaluates to

$\frac{1}{k-1} (\log k(1-s) - \log (1-s) ) = \frac{\log k}{k-1}$

as required.

Lower bounds

We will need some parameters c,T,τ > 0 to be chosen later (in practice we take c close to 1 / logk, T a small multiple of c, and τ a small multiple of c/k).

For any symmetric function F on the simplex ${\mathcal R}_k$, one has

$J_k^{(1)}(F) \leq \frac{M_k}{k} I_k(F)$

and so by scaling, if F is a symmetric function on the dilated simplex $r \cdot {\mathcal R}_k$, one has

$J_k^{(1)}(F) \leq \frac{r M_k}{k} I_k(F)$

after adjusting the definition of the functionals $I_k, J_k^{(1)}$ suitably for this rescaled simplex.

Now let us apply this inequality to truncated tensor product functions

$F(t_1,\ldots,t_k) = 1_{t_1+\ldots+t_k\leq r} \prod_{i=1}^k m_2^{-1/2} g(t_i)$

for some bounded measurable $g: [0,T] \to {\mathbf R}$, not identically zero, with $m_2 := \int_0^T g(t)^2\ dt$. We have the probabilistic interpretations

$J_k^{(1)}(F) := m_2^{-1} {\mathbf E} ( \int_{[0, r - S_{k-1}]} g(t)\ dt)^2$

and

$I(F) := m_2^{-1} {\mathbf E} \int_{[0,r - S_{k-1}]} g(t)^2\ dt$
$= {\mathbf P} (S_k \leq r)$

where $S_{k-1} := X_1 + \ldots X_{k-1}$, $S_k := X_1 + \ldots + X_k$ and $X_1,\ldots,X_k$ are iid random variables in [0,T] with law $m_2^{-1} g(t)^2\ dt$, and we adopt the convention that

 ∫ f [a,b]

vanishes when b < a. We thus have

${\mathbf E} ( \int_{[0, r - S_{k-1}]} g(t)\ dt)^2 \leq \frac{r M_k}{k} m_2 {\mathbf P} ( S_k \leq r )$ (*)

for any r.

We now introduce the random function h = hr by

$h(t) := \frac{1}{r - S_{k-1} + (k-1) t} 1_{S_{k-1} < r}.$

Observe that if Sk − 1 < r, then

$\int_{[0, r-S_{k-1}]} h(t)\ dt = \frac{\log k}{k-1}$

and hence by the Legendre identity

$( \int_{[0, r - S_{k-1}]} g(t)\ dt)^2 = \frac{\log k}{k-1} \int_{[0, r - S_{k-1}]} \frac{g(t)^2}{h(t)}\ dt - \frac{1}{2} \int_{[0,r-S_{k-1}]} \int_{[0,r-S_{k-1}]} \frac{(g(s) h(t)-g(t) h(s))^2}{h(s) h(t)}\ ds dt.$

We also note that (using the iid nature of the Xi to symmetrise)

${\mathbf E} \int_{[0, r - S_{k-1}]} g(t)^2/h(t)\ dt = m_2 {\mathbf E} 1_{S_k \leq r} / h( X_k )$
$= m_2 {\mathbf E} 1_{S_k \leq r} (1 - X_1 - \ldots - X_k + k X_k )$
$= m_2 {\mathbf E} 1_{S_k \leq r}$
$= m_2 {\mathbf P}( S_k \leq r ).$

Inserting these bounds into (*) and rearranging, we conclude that

$r \Delta_k {\mathbf P} ( S_k \leq r ) \leq \frac{k}{2m_2} {\mathbf E} \int_{[0,r-S_{k-1}]} \int_{[0,r-S_{k-1}]} \frac{(g(s) h(t)-g(t) h(s))^2}{h(s) h(t)}\ ds dt$

where $\Delta_k := \frac{k}{k-1} \log k - M_k$ is the defect from the upper bound. Splitting the integrand into regions where s or t is larger than or less than T, we obtain

$r \Delta_k {\mathbf P} ( S_k \leq r ) \leq Y_1 + Y_2$

where

$Y_1 := \frac{k}{m_2} {\mathbf E} \int_{[0,T]} \int_{[T,r-S_{k-1}]} \frac{g(t)^2}{h(t)} h(s)\ ds dt$

and

$Y_2 := \frac{k}{2 m_2} {\mathbf E} \int_{[0,\min(r-S_{k-1},T)]} \int_{[0,\min(r-S_{k-1},T)]} \frac{(g(s) h(t)-g(t) h(s))^2}{h(s) h(t)}\ ds dt.$

We now focus on Y1. It is only non-zero when $S_{k-1} \leq r-T$. Bounding $h(s) \leq \frac{1}{(k-1)s}$, we see that

$Y_1 \leq \frac{k}{(k-1) m_2} {\mathbf E} \int_0^T \frac{g(t)^2}{h(t)}\ dt \times \log_+ \frac{r-S_{k-1}}{T}$

where log + (x) is equal to logx when $x \geq 1$ and zero otherwise. We can rewrite this as

$Y_1 \leq \frac{k}{k-1} {\mathbf E} 1_{S_k \leq r} \frac{1}{h(X_k)} \log_+ \frac{r-S_{k-1}}{T}.$

We write $\frac{1}{h(X_k)} = r-S_k + kX_k$ and $\frac{r-S_{k-1}}{T} = \frac{r-S_k}{T} + \frac{X_k}{T}$. Using the bound $\log_+(x+y) \leq \log_+(x) + \log_+(1+y)$ we have

$\log_+ \frac{r-S_{k-1}}{T} \leq \log_+ \frac{r-S_{k}}{T} + \log(1 + \frac{X_k}{T})$

and thus (bounding $\log(1+\frac{X_k}{T}) \leq \frac{X_k}{T}$.

$Y_1 \leq \frac{k}{k-1} {\mathbf E} (r-S_k + kX_k) \log_+ \frac{r-S_{k}}{T} + (r-S_k)_+ \frac{X_k}{T} + k X_k \log(1+\frac{X_k}{T})$.

Symmetrising, we conclude that

$Y_1 \leq \frac{k}{k-1} (Z_1 + Z_2 + Z_3)$

where

$Z_1 := {\mathbf E} r \log_+ \frac{r-S_{k}}{T}$
$Z_2 := {\mathbf E} (r-S_k)_+ \frac{S_k}{kT}$
$Z_3 := m_2^{-1} \int_0^T kt \log(1 + \frac{t}{T}) g(t)^2\ dt.$

If we have the pointwise bound

$r \log_+ \frac{r-s}{T} + (r-s)_+ \frac{s}{kT} \leq C (s - s_0)^2 + C'$ (*)

for some C,C',s0 > 0 and all s, then we have

$Z_1 + Z_2 \leq C {\mathbf E} (S_k - s_0)^2$
= C((kμ − s0)2 + kσ2) + C'

where

$\mu := m_2^{-1} \int_0^T t g(t)^2\ dt$
$\sigma^2 := m_2^{-1} \int_0^T t^2 g(t)^2\ dt - \mu^2.$

Thus far, our arguments have been valid for arbitrary functions g. We now specialise to functions of the form

$g(t) := \frac{1}{c+(k-1)t}.$

Note the identity

g(t) − h(t) = (rSk − 1c)g(t)h(t)

on [0,min(rSk − 1,T)]. Thus

$Y_2 = \frac{k}{2 m_2} {\mathbf E} \int_{[0,\min(r-S_{k-1},T)]} \int_{[0,\min(r-S_{k-1},T)]} \frac{((g-h)(s) h(t)-(g-h)(t) h(s))^2}{h(s) h(t)}\ ds dt$
$= \frac{k}{2 m_2} {\mathbf E} (r - S_{k-1} - c)^2 \int_{[0,\min(r-S_{k-1},T)]} \int_{[0,\min(r-S_{k-1},T)]} (g(s)-g(t))^2 h(s) h(t)\ ds dt.$

Bounding $(g(s)-g(t))^2 \leq g(s)^2+g(t)^2$ and using symmetry, we conclude

$Y_2 \leq \frac{k}{m_2} {\mathbf E} (r - S_{k-1} - c)^2 \int_{[0,\min(r-S_{k-1},T)]} \int_{[0,\min(r-S_{k-1},T)]} g(s)^2 h(s) h(t)\ ds dt.$

Since $\int_0^{r-S_{k-1}} h(t)\ dt = \frac{\log k}{k-1}$, we conclude that

$Y_2 \leq \frac{k}{k-1} Z_4$

where Z4 = Z4[r] is the quantity

$Z_4 := \frac{\log k}{m_2} {\mathbf E} (r - S_{k-1} - c)^2 \int_{[0,\min(r-S_{k-1},T)]} g(s)^2 h_r(s)\ ds.$

Putting all this together, we have

$r \Delta_k {\mathbf P} ( S_k \leq r ) \leq \frac{k}{k-1} ( C ( (k \mu - s_0)^2 + k \sigma^2 ) + C' + Z_3 + Z_4[r] ).$

At this point we encounter a technical problem that Z4 diverges logarithmically (up to a cap of logk) as Sk − 1 approaches r. To deal with this issue we average in r, and specifically over the interval [1,1 + τ]. We assume that the pointwise bound (*) is valid for all r in this interval. If we have

$\int_0^1 (1+a\tau) 1_{x > 1+a\tau}\ da \leq \delta (x-k\mu)^2$

for all x and some δ > 0, then

$\int_0^1 (1+a\tau) {\mathbf P} ( S_k \leq 1+a\tau )\ da \leq 1 + \frac{\tau}{2} - k \delta \sigma^2$

and hence

$\Delta_k (1 + \frac{a\tau}{2} - k \delta \sigma^2) \leq \frac{k}{k-1} ( C ( (k \mu - s_0)^2 + k \sigma^2 ) + C' + Z_3 + \int_0^1 Z_4[1+a\tau]\ da ).$

If $\tau \leq c$, we may bound

$\int_0^1 Z_4[1+a\tau]\ da := \frac{\log k}{m_2} {\mathbf E} ((1 - S_{k-1})^2 + c^2) \int_{[0,T)]} g(s)^2 (\int_0^1 h_{1+a\tau}(s) 1_{1+a\tau-S_{k-1} \geq s}\ da)\ ds.$

Observe that

$\int_0^1 h_{1+a\tau}(s) 1_{1+a\tau-S_{k-1} \geq s}\ da = \int_0^1 \frac{da}{1-S_{k-1}+a\tau+(k-1)s} 1_{1-S_{k-1}+a\tau \geq s}$
$= \frac{1}{\tau} \int_{[\max(ks, 1-S_{k-1}+(k-1)s), 1-S_{k-1}+\tau+(k-1)s]} \frac{du}{u}$
$\leq \frac{1}{\tau} \log \frac{ks+\tau}{ks}$

and so

$\int_0^1 Z_4[1+a\tau]\ da \leq W \frac{\log k}{\tau} {\mathbf E} ((1 - S_{k-1})^2 + c^2)$
$= W \frac{\log k}{\tau} ((1 - (k-1)\mu)^2 + (k-1) \sigma^2 + c^2)$

where

$W := m_2^{-1} \frac{1}{\tau} \int_{[0,T)]} g(s)^2 \log(1+\frac{\tau}{ks})\ ds.$

We thus arrive at the final bound

$\Delta_k \leq \frac{k}{k-1} \frac{ C ( (k \mu - s_0)^2 + k \sigma^2 ) + C' + Z_3 + W \frac{\log k}{\tau} ((1 - (k-1)\mu)^2 + (k-1) \sigma^2 + c^2)}{1 + \frac{\tau}{2} - k \delta \sigma^2}$

provided that the denominator is positive.

If we set c = τ: = 1 / logk, with T a small multiple of c, then $\mu \approx \frac{1}{k}(1 - \frac{A}{\log k})$ for a large absolute constant A, and σ2 is a small multiple of $\frac{1}{k \log^2 k}$. This makes the denominator comparable to 1; if we then set s0 = kμ, then one can check that (*) holds with C = O(log2k) and C' = O(1); also, Z3,W = O(1), finally giving the bound

Δk = O(1)

and thus we have the lower bound

$M_k \geq\frac{k}{k-1} \log k - O(1) = \log k - O(1)$.

More general variational problems

It appears that for the purposes of establish DHL type theorems, one can increase the range of F in which one is taking suprema over (and extending the range of integration in the definition of $J_k^{(m)}(F)$ accordingly). Firstly, one can enlarge the simplex ${\mathcal R}_k$ to the larger region

${\mathcal R}'_k = \{ (t_1,\ldots,t_k) \in [0,1]^k: t_1+\ldots+t_k \leq 1 + \min(t_1,\ldots,t_k) \}$

provided that one works with a generalisation of EH[θ] which controls more general Dirichlet convolutions than the von Mangoldt function (a precise assertion in this regard may be found in BFI). In fact one should be able to work in any larger region R for which

$R + R \subset \{ (t_1,\ldots,t_k) \in [0,2/\theta]^k: t_1+\ldots+t_k \leq 2 + \max(t_1,\ldots,t_k) \} \cup \frac{2}{\theta} \cdot {\mathcal R}_k$

provided that all the marginal distributions of F are supported on ${\mathcal R}_{k-1}$, thus (assuming F is symmetric)

$\int_0^\infty F(t_1,\ldots,t_{k-1},t_k)\ dt_k = 0$ when $t_1+\ldots+t_{k-1} > 1.$

For instance, one can take $R = \frac{1}{\theta} \cdot {\mathcal R}_k$, or one can take $R = \{ (t_1,\ldots,t_k) \in [0,1/\theta]^k: t_1 +\ldots +t_{k-1} \leq 1 \}$ (although the latter option breaks the symmetry for F). Perhaps other choices are also possible.

World records

k Mk M'k M''k
Lower Upper Lower Upper Lower Upper
2 1.38593... 1.38593... 2 2 2 2
3 1.646 1.648 1.842 2.080 1.917 2.38593...
4 1.845 1.848 1.937 2.198 2.648
5 2.001162 2.011797 2.059 2.311 2.848
10 2.53 2.55842
20 3.05 3.1534
30 3.34 3.51848
40 3.52 3.793466
50 3.66 3.99186
59 3.95608 4.1479398

For k>2, all upper bounds on Mk come from (1). Upper bounds on M'k come from the inequality $M'_k \leq \frac{k}{k-1} M_{k-1}$ that follows from an averaging argument, and upper bounds on M''k (on EH, using the prism $\{ t_1+\ldots+t_{k-1},t_k \leq 1\}$ as the domain) come from the inequality $M''_k \leq M_{k-1} + 1$ by comparing M''k with a variational problem on the prism (details here).

For k=2, M'2 = M''2 = 2 can be computed exactly by taking F to be the indicator function of the unit square (for the lower bound), and by using Cauchy-Schwarz (for the upper bound). $M_2=\frac{1}{1-W(1/e)} \approx 1.385893$ can be computed exactly as the solution to the equation $2-\frac{1}{x} + \log(1-\frac{1}{x}) = 0$.