[sledge] Clamp rational numerator and denominator to bitwidth

Summary:
When constructing division expressions from rational coefficients of
polynomials, the constant numerator and denominator should be clamped
to the number of bits in the result type.

Reviewed By: mbouaziz

Differential Revision: D15098825

fbshipit-source-id: fa448c39a
master
Josh Berdine 6 years ago committed by Facebook Github Bot
parent 07e8ac2d6a
commit 8f2af62480

@ -737,7 +737,11 @@ let rec sum_to_exp typ sum =
| _ -> Add {typ; args= sum} )
| _ -> Add {typ; args= sum}
and rational Q.{num; den} typ = simp_div (integer num typ) (integer den typ)
and rational Q.{num; den} typ =
let bits = Option.value_exn (Typ.prim_bit_size_of typ) in
simp_div
(integer (Z.clamp ~signed:true bits num) typ)
(integer (Z.clamp ~signed:true bits den) typ)
and simp_div x y =
match (x, y) with

Loading…
Cancel
Save